-- Logs begin at Tue 2022-05-03 11:33:00 UTC, end at Tue 2022-05-03 12:45:49 UTC. -- May 03 12:04:24.634398 dv-cinder-824911-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 12:04:24.642615 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 12:04:24.645408 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 12:04:24 2022] *** May 03 12:04:24.645614 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 12:04:24.645784 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 12:04:24.645961 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: nodename: dv-cinder-824911-5-iscsi May 03 12:04:24.646120 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: machine: x86_64 May 03 12:04:24.646285 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: clock source: unix May 03 12:04:24.646439 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: pcre jit disabled May 03 12:04:24.646598 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: detected number of CPU cores: 4 May 03 12:04:24.646751 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: current working directory: / May 03 12:04:24.646906 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: detected binary path: /usr/bin/uwsgi-core May 03 12:04:24.647066 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: your processes number limit is 47680 May 03 12:04:24.647214 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: your memory page size is 4096 bytes May 03 12:04:24.647361 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: detected max file descriptor number: 2048 May 03 12:04:24.647524 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: lock engine: pthread robust mutexes May 03 12:04:24.647827 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: thunder lock: enabled May 03 12:04:24.648182 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 12:04:24.648476 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 12:04:24.694786 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: Python main interpreter initialized at 0x55fc2ab149c0 May 03 12:04:24.694786 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: python threads support enabled May 03 12:04:24.694786 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: your server socket listen backlog is limited to 100 connections May 03 12:04:24.694786 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: your mercy for graceful operations on workers is 90 seconds May 03 12:04:24.695153 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: mapped 403077 bytes (393 KB) for 2 cores May 03 12:04:24.695229 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: *** Operational MODE: preforking *** May 03 12:04:24.695490 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: *** uWSGI is running in multiple interpreter mode *** May 03 12:04:24.695490 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: spawned uWSGI master process (pid: 80117) May 03 12:04:24.695708 dv-cinder-824911-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 12:04:24.696564 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: spawned uWSGI worker 1 (pid: 80131, cores: 1) May 03 12:04:24.696802 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: spawned uWSGI worker 2 (pid: 80132, cores: 1) May 03 12:04:24.696961 dv-cinder-824911-5-iscsi devstack@keystone.service[80117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 12:04:30.472195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 12:04:30.472195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: from cryptography.utils import int_from_bytes May 03 12:04:30.473007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 12:04:30.473007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes May 03 12:04:30.473412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 12:04:30.473412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: from cryptography.utils import int_from_bytes May 03 12:04:30.473524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 12:04:30.473524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes May 03 12:04:30.522190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 12:04:30.522340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 12:04:30.522423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 12:04:30.522660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 12:04:30.522749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] command line args: [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 12:04:30.522815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] command line args: [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 12:04:30.522872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 12:04:30.523028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 12:04:30.523113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ================================================================================ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 12:04:30.523183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ================================================================================ {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 12:04:30.523248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] admin_token = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] config_dir = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] config_dir = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] config_source = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.523998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] config_source = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.524055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] debug = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.524117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] debug = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.524186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.526967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_config_append = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_config_append = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_dir = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_file = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_dir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.527991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.528959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.529021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.529090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.529157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.529225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.529910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.530093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.530093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.530458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.530458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] publish_errors = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.530840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.531039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.531265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] publish_errors = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.531438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.531647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.531837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.532026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.532255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.532466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.532684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.532880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.533045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] standard_threads = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.533971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.534137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.534333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] standard_threads = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.534530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.534725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.534914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] use_journal = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] use_json = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] use_journal = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] use_stderr = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.535919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] use_syslog = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.536208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] use_json = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.536208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] use_stderr = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.536488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.536626 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] use_syslog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.536789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.536959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 12:04:30.537103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.537894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.538956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.539994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.540899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.541951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.542869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.543920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.544881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.545927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.547128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.547302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.547496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.547726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.547889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.548078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.548078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.548503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.548737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.548938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.549167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.549373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.549536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.549726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.549963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.550921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.551299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.551299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.551664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.551849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.552038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.552210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.552415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.552599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.552744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.553984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.554916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.555992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.556979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.557895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.558988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.559886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.560966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.561881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562009 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.562936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.563982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.564937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.565980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.566906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.external = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.567942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.external = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.password = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.568916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] auth.token = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.password = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.token = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.569996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.570997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.571930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.572983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.573923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.574932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.575971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.576923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.577969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.578920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.579049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.579465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.579601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.579730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.579859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.580792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.580930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.581991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.582902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.583955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.584909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.585941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.586996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.587768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.588958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.589989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.590915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.591974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.592950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.593995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.594858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.595067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.595230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.595372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.595502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.596885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.597919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.598988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.599967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.600952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.601991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.602896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.603953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.604889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.605930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] role.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] role.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.606971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] role.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.607886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] role.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.608920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.609926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.610749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.611865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.612980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.613952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.614917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.615872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.616894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.617997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.618972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.619925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.620913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.connection = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.621898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.622942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.623914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.624991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.625974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 12:04:30.626795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 12:04:30.638492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.638699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.638851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.638990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.639156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.639299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.648248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.648474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.676895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.677145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.677303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.677478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.730429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.730696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.781957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.782203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.782299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.782508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.849908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.850625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.873371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.873595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.873684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.873856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.873937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.874774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.875073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.886554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.887186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.901859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.902940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.903054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.903142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.903362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.903514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.903604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 12:04:30.920997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.921216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 12:04:30.921417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.921550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.921640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 12:04:30.921756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 12:04:30.921948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 12:04:30.922260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.922931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.923182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.934981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.935182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.943561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.943803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.946862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.947089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.947217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.947409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.947559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.947684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.947805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.948988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.949878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.976733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.977094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.978365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.978647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.978791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.978995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.983925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.984200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.984501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.984629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.984844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.985122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.991829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.992114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.992410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.992695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.996785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.997072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.997303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:30.997445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.997592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.997716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.997872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.997995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.998952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:30.999172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.018343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.018615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.018839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.019114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.023156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.023621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.026788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.027085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.027243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.027508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.032060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.032484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.035697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.036061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.039464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.039763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.039890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.040913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.041038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.041175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.060187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.060350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.060591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.060718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.060840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.060963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.061085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.061221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.069612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.071272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.071546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.073496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.074617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.074897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.075184 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.075466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.075611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.075736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.075940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.079091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.079448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.079813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.080740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.081087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.089903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.090181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.090456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.090733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.091011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.091284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.091564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.095033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.095385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.095759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.096115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.096484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.096838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.097183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.109594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.112913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.115461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.116207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.117835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.118979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.119454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.119730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.120008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.122578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.124241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.125947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.126299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.126650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.127916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.129530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.132754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.133043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.133332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.133608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.135122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.136816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.140083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.140464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.140819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.141165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.143386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.143676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.143958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.151193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.151562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.151831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.151958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.152090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.152396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.152666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.152934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.153201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.153469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.153747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.154021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.154287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.154562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.154817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.155077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.155350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.160952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 12:04:31.161330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.161691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.162048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.162390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.162731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.163078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.163430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.163770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.164124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.164486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.164817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.165151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.165494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 12:04:31.196485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fc2ab149c0 pid: 80132 (default app) May 03 12:04:31.199967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db7ca-1ebe-4cff-b70e-04f3ef12bcf5 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:31.200259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db7ca-1ebe-4cff-b70e-04f3ef12bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:31.200560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1db7ca-1ebe-4cff-b70e-04f3ef12bcf5 None None] PATH_INFO: `/v3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:31.205202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Tue May 3 12:04:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:31.206369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fc2ab149c0 pid: 80131 (default app) May 03 12:04:39.963690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:39.964263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:39.964263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:39.965601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:04:39.973581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:39.973979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:39.974144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:40.003563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG oslo_db.sqlalchemy.engines [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 12:04:40.183326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 12:04:40.183751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 12:04:40.238771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:40.240287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:40.368239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1/3] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 12:04:40.524680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:40.558176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG oslo_db.sqlalchemy.engines [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 12:04:40.692322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f306c-090c-47ad-a555-3360fd355a98 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:40.696804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:40.697503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:40.697785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:40.698063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:40.706738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:40.758578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING keystone.common.rbac_enforcer.enforcer [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 12:04:40.758916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47205b5a-0a11-4882-a892-332fa1ed77ca admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:40.769080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 3/4] 10.222.0.21 () {58 vars in 1324 bytes} [Tue May 3 12:04:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:04:40.775109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:40.789090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13201d3-7cc5-4988-bfbd-8a1a97931f14 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:40.793488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:40.794607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:40.794886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:40.795166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] PATH_INFO: `/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:40.796693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] RBAC: Authorizing `identity:get_project(project_id=c04ced0b5ee84470a3d6e754eca1d8a4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:40.846857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 12:04:40.847186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71475d3-e15a-4594-8f03-e6bc1e86f254 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:40.851654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 2/5] 10.222.0.21 () {56 vars in 1207 bytes} [Tue May 3 12:04:40 2022] GET /identity/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:43.059880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba13b6-385e-48ec-9f7a-a148e4f28780 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:43.060414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba13b6-385e-48ec-9f7a-a148e4f28780 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:43.060513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba13b6-385e-48ec-9f7a-a148e4f28780 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:43.064554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 4/6] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:43.069788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:43.070224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:43.070345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:43.089706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:43.091200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:43.099503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 3/7] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 12:04:43.122093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba13b6-385e-48ec-9f7a-a148e4f28780 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:43.133656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba13b6-385e-48ec-9f7a-a148e4f28780 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:43.137742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:43.138360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:43.138638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:43.138910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:43.146808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:43.148591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5959a-9a36-4074-8458-d4c6587190fa admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:43.156984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 5/8] 10.222.0.21 () {58 vars in 1324 bytes} [Tue May 3 12:04:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:04:43.162653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:43.171393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3525-07a7-436f-a579-bc2459fe1aff None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:43.175697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:43.176589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:43.176871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:43.177141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:43.178779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:43.180603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f55a3e-4f99-4854-afd7-7e87503f644b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:43.182142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 4/9] 10.222.0.21 () {56 vars in 1198 bytes} [Tue May 3 12:04:43 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:45.493088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0a23-ed86-4637-80ab-a1d2576df260 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.493616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0a23-ed86-4637-80ab-a1d2576df260 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.493616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a0a23-ed86-4637-80ab-a1d2576df260 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.494986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:45.500088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.500546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.500685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.510143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbdb1-ebfd-4743-b2ec-d4b37ba8d895 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.510432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbdb1-ebfd-4743-b2ec-d4b37ba8d895 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.510712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cbdb1-ebfd-4743-b2ec-d4b37ba8d895 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.512031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 7/11] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:04:45.517601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.517895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.518172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.559252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG passlib.handlers.bcrypt [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80132) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 12:04:45.559661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG passlib.handlers.bcrypt [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80132) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 12:04:45.613560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:45.615112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:45.624623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:45.625820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:45.703818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 5/12] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:45.711544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 8/13] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:04:45.727000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:45.733246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:45.822870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4a02-adda-46db-b3d1-71bf03f7e07f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:45.826633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7325a-dbc3-4f4d-909a-38c7e92e4740 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:45.854306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:45.855094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.855377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.855650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.858174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:45.859063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:45.859348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:45.859627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:45.866803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:04:45.877889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:04:45.878786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:04:45.879615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 6/14] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:04:45.884799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:45.922953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:45.925055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:45.976978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808444a-2ed3-4e78-9488-f9c9e335598f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.009110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.009785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.010062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.010330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.011080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:46.011383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.012809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.020496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 9/15] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:04:46.024932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 7/16] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:46.026229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:46.030135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:46.119924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966db1-c6b9-47a4-9dd5-836f2a310313 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.124715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1af59-c32b-488d-9db1-d9f43bb155cc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.150882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.151669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.151952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.152227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.157333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.158856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.159133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.159402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.160714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.162199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.163867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 8/17] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:04:46 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:46.169468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:46.268387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e898c-cada-462f-b087-eabc643ea8f9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.277087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.278547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:04:46.299484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:04:46.300520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:04:46.301523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:04:46.301523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:04:46.301523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:04:46.301523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:04:46.301784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.301879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 10/18] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:04:46.301961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.301961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.302180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.303550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.305011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.311029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 9/19] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:46.311178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:46.311924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:46.401116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da793e-224d-4126-8215-5db5625fbe83 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.405754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c387d-cbde-4a32-9792-d2404c4b4fbf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:46.432985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.433644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.433923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.434199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.434925 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:46.435234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.436638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dc4a7-2460-47a0-9aed-6ae02bd87efe None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.437759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:46.438409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:46.438723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:46.439002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:46.439831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.domain.id=default, user.id=999bb4f35c6e4023831d5433d656d3cf) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:46.440141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:46.441597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae718f2-5ec1-4595-9de2-ebf8686947d6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:46.448171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 10/20] 10.222.0.21 () {56 vars in 1322 bytes} [Tue May 3 12:04:46 2022] GET /identity/v3/role_assignments?user.id=999bb4f35c6e4023831d5433d656d3cf&scope.domain.id=default&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:46.453249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 11/21] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:49.396935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4dd7-4d8b-4136-8064-e06059e2fb9d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.397434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4dd7-4d8b-4136-8064-e06059e2fb9d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.397570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4dd7-4d8b-4136-8064-e06059e2fb9d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.399186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 11/22] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:49.413008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c7b3-e103-461f-b8f4-c71ad000b754 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.413466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c7b3-e103-461f-b8f4-c71ad000b754 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.413537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685c7b3-e103-461f-b8f4-c71ad000b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.435481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7685c7b3-e103-461f-b8f4-c71ad000b754 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:49.436759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7685c7b3-e103-461f-b8f4-c71ad000b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:49.449876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0185-fb64-43bf-b31d-a3012a952039 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.450165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0185-fb64-43bf-b31d-a3012a952039 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.450447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0185-fb64-43bf-b31d-a3012a952039 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.451929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 12/23] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:04:49.456661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.456950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.457224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.481344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:49.482833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:49.533678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 12/24] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:49.535325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46309c5-d31e-4db2-98cd-b6eb09c36e68 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.535834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46309c5-d31e-4db2-98cd-b6eb09c36e68 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.540380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46309c5-d31e-4db2-98cd-b6eb09c36e68 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.542769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 13/25] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:49.548724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.549276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.549764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.579867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:49.581076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:49.630764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 13/26] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:04:49.631613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:49.663549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 14/27] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:04:49.706410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:49.812407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e75c5-0af4-4c3e-b187-c380371e4a11 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:49.825882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c741b6-eaa0-4598-9592-33a69dcf8cac None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:49.847867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:49.848950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.850119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.850725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.869242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:49.871909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:49.901180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:04:49.901716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:04:49.902659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:04:49.903639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:04:49.903639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:04:49.903639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:04:49.903639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:04:49.903881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:49.903881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:49.903881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:49.903881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:49.904399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09fd78-f37e-4f0d-af85-788c5d0d9eab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:49.905594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 15/28] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:04:49.906507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.005366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2953f-8a0c-459a-be9e-dc4392df5e16 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.049868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.050898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.051367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.051788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.064736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:04:50.074644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:04:50.075695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:50.076665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:04:50.078947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 16/29] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:04:50.080392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.155695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 14/30] 10.222.0.21 () {60 vars in 1131 bytes} [Tue May 3 12:04:49 2022] POST /identity/v3/roles => generated 219 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:04:50.157861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad77e3-db2d-4a29-bd0d-1009b6b9f10f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.158160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad77e3-db2d-4a29-bd0d-1009b6b9f10f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.158429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad77e3-db2d-4a29-bd0d-1009b6b9f10f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.165114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 15/31] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:50.166118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad77e3-db2d-4a29-bd0d-1009b6b9f10f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.192927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca947-3e3e-415d-90b5-298bb3efe63f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.233450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.234448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.235682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.236641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.238171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:50.240846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:50.242691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabef0-11e5-4356-afec-6506d0b37a6c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:50.270018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 17/32] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:50.272634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.274859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.275350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.312896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:50.316662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:50.395496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad77e3-db2d-4a29-bd0d-1009b6b9f10f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.409503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 18/33] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:50.412421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.453230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.453901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.455259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.455259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.455774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:50.456083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:50.457774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:50.467331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 16/34] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:50.468342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.541272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b341bdf-48b8-4b06-9dab-c9acbcb455a1 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.573622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8928b7e-678a-454e-9465-d6d4df556e90 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.573793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.574279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.574563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.574839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.575765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:50.577353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873d204-dccd-4b78-8e3e-831a3486de8d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:50.606738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.607401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.607687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.607964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.608764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:50.610191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd7476-a795-4314-ba41-54ef3afc324d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:50.669408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 17/35] 10.222.0.21 () {60 vars in 1131 bytes} [Tue May 3 12:04:50 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:04:50.670623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d912-7c01-40ba-aecb-2d39557b33f5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.670912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d912-7c01-40ba-aecb-2d39557b33f5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.671188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d912-7c01-40ba-aecb-2d39557b33f5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.672646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 18/36] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:50.677976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45d912-7c01-40ba-aecb-2d39557b33f5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.760716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 19/37] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:04:50 2022] POST /identity/v3/projects => generated 301 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:04:50.762417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e51f-98b9-4b47-a16d-61f1e4558496 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.762715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e51f-98b9-4b47-a16d-61f1e4558496 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.762997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e51f-98b9-4b47-a16d-61f1e4558496 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.764437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 20/38] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:50.765715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.766002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.766280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.801668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:50.803711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:50.814944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45d912-7c01-40ba-aecb-2d39557b33f5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:50.870056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:50.870780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.871072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.871350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.873317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:50.874285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca489d1-3a42-4f45-9089-76ae01a34e34 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:50.878010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 19/39] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:04:50 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:50.879222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:50.879513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:50.879790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:50.894188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 21/40] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:50.895352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:50.903730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:50.905358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:50.983387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 20/41] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:50.984035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:51.009995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84af54-ba62-45fe-ad92-27cdb5827baa None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:51.048940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:51.049747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:51.050028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:51.050956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:51.052179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:51.054084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:51.055689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 22/42] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:51.056440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:51.094968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3af1f-9040-453a-ae93-57288073b2ce None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:51.128782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:51.129582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:51.129876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:51.130141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:51.131310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:51.132808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:51.134419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:51.135263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:51.153823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd5cf-db97-4b39-a955-110817bab37c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:51.186311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:51.186980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:51.187266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:51.187546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:51.188292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:51.190219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:51.232791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338c132-3cb9-4691-b044-d7ab3058a738 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:51.265389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:51.266191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:51.266492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:51.267357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] PATH_INFO: `/v3/domains/default/users/999bb4f35c6e4023831d5433d656d3cf/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:51.269435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=999bb4f35c6e4023831d5433d656d3cf, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:51.270882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe928b3-80cf-4a50-9e1e-6749baed2efe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:51.271438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1131 bytes} [Tue May 3 12:04:51 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:04:51.272238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:51.344531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 22/45] 10.222.0.21 () {58 vars in 1361 bytes} [Tue May 3 12:04:51 2022] PUT /identity/v3/domains/default/users/999bb4f35c6e4023831d5433d656d3cf/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:04:51.401138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761af78d-0c70-4fff-ab90-5246523b861b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:51.439414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:51.440106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:51.440417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:51.440704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:51.441443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:51.442965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eade7a4-ce05-416e-a3d2-7f3dc3d451ca None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:51.536869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:04:51 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:04:53.583808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe1f4-6b2c-4946-bb84-4af312b5ba53 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.584319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe1f4-6b2c-4946-bb84-4af312b5ba53 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.584516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe1f4-6b2c-4946-bb84-4af312b5ba53 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.585895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 23/47] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:53.591108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f65d0-681a-4a5d-9ea1-381c5f31596c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.591511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f65d0-681a-4a5d-9ea1-381c5f31596c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.591798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f65d0-681a-4a5d-9ea1-381c5f31596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.609693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f97f65d0-681a-4a5d-9ea1-381c5f31596c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:53.611462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f97f65d0-681a-4a5d-9ea1-381c5f31596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:53.677189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 25/48] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:53.700304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe1f4-6b2c-4946-bb84-4af312b5ba53 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:53.797548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe1f4-6b2c-4946-bb84-4af312b5ba53 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:53.798155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058092f-bd80-4883-bd87-8ba65517a5f8 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.798455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058092f-bd80-4883-bd87-8ba65517a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.798739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058092f-bd80-4883-bd87-8ba65517a5f8 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.800125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 26/49] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:04:53.805357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.805648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.805932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.821907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:53.823077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:53.830273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:53.831064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.831354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.831633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.841347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:04:53.849669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:04:53.850488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:04:53.851463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 24/50] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:04:53.856540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:53.885201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 27/51] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:04:53.909178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:53.949116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0fb47-ce84-497b-b2bb-eb91b54b2db5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:53.981446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:53.982108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:53.982396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:53.982677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:53.983430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:53.983740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:53.985187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:53.992878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 25/52] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:53.998260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:54.000679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff517c-d0e4-4483-ac0e-fe163677f44d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:54.032852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:54.033641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:54.033927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:54.034202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:54.035372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:54.036879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:54.038470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 28/53] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:54.043896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:54.090707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c4b9-2d3d-4f7e-b132-47f5128b38bb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:54.121353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:54.122208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:54.122500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:54.122777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:54.123961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:54.125431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:54.127578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 26/54] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:04:53 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:54.132927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:54.134010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a72ba-fa91-4890-81fa-75f924d67713 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:54.170113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:54.170700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:54.170982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:54.171264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:54.171963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:54.173438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:54.224930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f0b7-0d83-48ee-bd01-b07106e3b999 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:54.255697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:54.256500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:54.256790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:54.257053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:54.258226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:54.259251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 29/55] 10.222.0.21 () {60 vars in 1140 bytes} [Tue May 3 12:04:54 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:04:54.259698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217650b-bd67-4535-9ee4-2e3c2f187384 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:54.261318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 27/56] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:04:54.267741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:54.370667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b057a-0004-45e8-8552-31074c89e928 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:54.405453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:54.406130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:54.406419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:54.406701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:54.407550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.domain.id=default, user.id=999bb4f35c6e4023831d5433d656d3cf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:04:54.407868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:54.409396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833e3e-0ddb-4336-8895-baa058c5b0e7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:54.420030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 30/57] 10.222.0.21 () {56 vars in 1322 bytes} [Tue May 3 12:04:54 2022] GET /identity/v3/role_assignments?user.id=999bb4f35c6e4023831d5433d656d3cf&scope.domain.id=default&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:56.561456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641e8c-f1f8-444e-94d8-ebed170b516d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:56.562003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641e8c-f1f8-444e-94d8-ebed170b516d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:56.562003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641e8c-f1f8-444e-94d8-ebed170b516d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:56.563510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 28/58] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:04:56.568580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:56.568954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:56.569146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:56.585032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:04:56.586191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:04:56.647659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 31/59] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:04:56.671862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b641e8c-f1f8-444e-94d8-ebed170b516d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:56.767648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b641e8c-f1f8-444e-94d8-ebed170b516d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:56.798633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:56.799407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:56.799691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:56.799965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:56.801133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:56.802809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a8da-f1ab-47c3-90cc-6fc35de1493b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:56.804403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 29/60] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:04:56.809599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:04:56.900072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fa810-b5c8-4b2f-a8c4-5345be397eb2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:04:56.931265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:04:56.931916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:04:56.932198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:04:56.932501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:04:56.933201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:04:56.934635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce3f42-1a65-4819-beda-a934c49b0862 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:04:57.017892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 32/61] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:04:56 2022] POST /identity/v3/users => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:00.499557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0636d5-8475-4155-a3b6-03f28142a22a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.499557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0636d5-8475-4155-a3b6-03f28142a22a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.499557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0636d5-8475-4155-a3b6-03f28142a22a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.499557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 30/62] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:00.504911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.505735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.506214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.529365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:00.530883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:00.613899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 33/63] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:00.642397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b32e-9219-4b5d-b6b5-5e9297ecb709 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.643023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b32e-9219-4b5d-b6b5-5e9297ecb709 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.643500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b32e-9219-4b5d-b6b5-5e9297ecb709 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.645094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 31/64] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:00.651564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:00.654655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924fdfc-bd7f-4fde-9e6d-a01e1ab98487 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.655192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924fdfc-bd7f-4fde-9e6d-a01e1ab98487 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.655690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924fdfc-bd7f-4fde-9e6d-a01e1ab98487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.678517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4924fdfc-bd7f-4fde-9e6d-a01e1ab98487 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:00.680757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4924fdfc-bd7f-4fde-9e6d-a01e1ab98487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:00.755034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495456-e027-453c-91ab-e4594ccf1429 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:00.764203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 32/65] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:00.767107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b38f-e408-4148-ac8c-6dc8b06deed5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.767580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b38f-e408-4148-ac8c-6dc8b06deed5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.768181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b38f-e408-4148-ac8c-6dc8b06deed5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.769712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 33/66] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:00.781670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.782715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.783126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.796842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:00.798004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.798511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.798990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.803819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:00.805046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:00.810826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:00.819814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:00.820780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:00.821544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:00.824078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 34/67] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:00.825237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:00.892471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 34/68] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:00.892471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:00.946042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f711-6788-4c41-98de-1fd1b8485e88 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:00.978340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:00.979010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7e54-91e0-442d-8a12-a76b3ec9fd2c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:00.979500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:00.979791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:00.980173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:00.990437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-21a3a89b-3497-4757-8854-8cc101f44ce5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:00.998495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:00.999344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:01.001080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 35/69] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:01.002002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824edac-0621-44e2-a539-256da6eb814a None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.002215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824edac-0621-44e2-a539-256da6eb814a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.002757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824edac-0621-44e2-a539-256da6eb814a None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.003979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 36/70] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:01.004860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824edac-0621-44e2-a539-256da6eb814a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.020815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.021484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.021762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.022034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.022775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:01.023078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.024461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.032237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 35/71] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.036721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.105016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824edac-0621-44e2-a539-256da6eb814a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.122809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ce34-ecde-4e2f-9d6f-4f723f2d0188 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.136413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.137204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.137490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.137770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.148109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:01.155694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-55c25f3f-34db-4ba8-9228-7c22b56c8625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:01.155830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:01.156668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:01.157421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:01.157998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.157998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.157998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.158169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:01.158230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:01.158230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.158352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce99b-cb49-402d-a1d2-944ffade802b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.158414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce99b-cb49-402d-a1d2-944ffade802b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.159010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce99b-cb49-402d-a1d2-944ffade802b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.159320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.160088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 38/73] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:01.161011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.161298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.161576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.171238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 36/74] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.171911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.178260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:01.179450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:01.241117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 39/75] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:01.241939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.267859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51d13-3a5f-41c2-8432-5c21de42b37f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.299608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.300506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.300798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.301078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.314957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.316427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe14b5-2575-45ee-9de1-5069900bde27 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.318071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 37/76] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.322544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.322544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.322544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.333979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881645a-8e0a-4ae1-9f61-c002da28dcf9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.334870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:01.336066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:01.365851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.366507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.366787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.367060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.367803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:01.368103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.369513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.380854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 40/77] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.381634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.399735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 38/78] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:01.400534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.482140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d20f-1663-4d50-9663-3bfa7548b56c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.501233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67a1b-677a-4dd4-a31c-6a3f02c41d40 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.513770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.514637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.514924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.515198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.516675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.518130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.519760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 41/79] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.520555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.533254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.534055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.534341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.534619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.535797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.537263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.538872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 39/80] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.539625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.613404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa8f0d-6fff-4fcd-a389-ce0a0603305b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.632466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb8d3-4ba6-4040-b978-8e5d57308e72 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.644403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.645046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.645327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.645599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.663926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.664749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.665033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.665310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.666500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.667975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.669627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 40/81] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:01.670376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.709351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.767866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6f570-7024-4ecd-a70b-3e4337df7cee None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.799606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.800412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.800706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.800982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.804798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 42/82] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:01.809769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.811621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:01.819524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:01.820492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:01.821252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 41/83] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:01.821876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:01.899088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cc178-b7a0-4946-824f-7338e921fedb None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.914537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c15a-8664-4c25-a0bf-98b94526bc93 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:01.930479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.931120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.931402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.931677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.945637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:01.946296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:01.946584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:01.946867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:01.947569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.949069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:01.993661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:01.995116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.045649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 42/84] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:01 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:02.046468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.092266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 43/85] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:02.093163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.154611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99224-28ad-4716-a5aa-66fea4eac87a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.191053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.191730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.191920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.192298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.193855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84c3e-2956-429e-a51b-018db29ac0fd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.229097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.230328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.230328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.230513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.231679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.233610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.235812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 44/86] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.237255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.262191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.263213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.337723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b57efc-29a7-4013-b5bc-7d9a59d8cfc7 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.403744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 43/87] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:02.404434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.404814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.405650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.406000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.406346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.407207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:02.407590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.409253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.418179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 45/88] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.419085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.503412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1a36-6690-4238-9629-42bbaa31a84a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.516890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe556a-4d71-435b-af41-746f4c772bb1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.537877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.538753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.539039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.539318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.540568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.542018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.543726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 44/89] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.548598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.552873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.553534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.553817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.554156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.554994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:02.555306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.556844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.562629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 46/90] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.563965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.654722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4ecc-faa4-4c9f-8f5a-e1b285bb6b41 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.675667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3f02-3b01-4d8a-bb1c-90824f62efad None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.690482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.691384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.691671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.691950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.693304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.694794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.696579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 45/91] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.697486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.711418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.712315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.712822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.713102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.714399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.715878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.717753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 47/92] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.718647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.800151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4790ce-be4f-4a12-a617-355b8452db4c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.824378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb3cd-c472-48e3-9761-37cb0a7c04ce None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:02.835271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.835953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.836241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.836544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.837389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:02.837703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.839176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.845712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 46/93] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=d718902dd4844e5cade3e242453c139a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:02.846521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:02.859562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:02.860802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:02.861080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:02.861350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:02.862187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=999bb4f35c6e4023831d5433d656d3cf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:02.862494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:02.864011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:02.870562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 48/94] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/role_assignments?user.id=999bb4f35c6e4023831d5433d656d3cf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:03.026677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731aabe-e55a-490d-a739-12434f9389ac None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:03.073652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:03.074343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:03.074627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:03.074908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:03.164386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:03.165901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:03.286085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 47/95] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:03.291650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:03.459510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b323-ffdd-4856-8351-eb6a2929e3fb None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:03.514405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:03.515659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:03.516731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:03.517185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] PATH_INFO: `/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:03.519005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] RBAC: Authorizing `identity:get_project(project_id=fbe8b9c9ec5a4ed5a5b113db0072943e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:03.520682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8962de-f75a-4712-b280-2ef275dc72c2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:03.522569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 49/96] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:03 2022] GET /identity/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:03.528529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:03.653804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f792b-7497-4bb3-b1f5-17b71fb06097 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:03.689623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:03.690549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:03.690971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:03.691380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:03.692354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=fbe8b9c9ec5a4ed5a5b113db0072943e, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:03.692823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:03.694436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1008c-ac74-4562-8140-b59a969b1d0c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:03.701035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 48/97] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:03 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=fbe8b9c9ec5a4ed5a5b113db0072943e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:05.187709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9564-a868-4676-b085-bdbcede7604d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.188412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9564-a868-4676-b085-bdbcede7604d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.188412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9564-a868-4676-b085-bdbcede7604d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.189953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 50/98] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:05.196284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.196829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.196829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.221452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:05.222656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:05.297413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0f58-98bc-4a92-add8-cd1a7199005f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.297716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0f58-98bc-4a92-add8-cd1a7199005f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.297958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0f58-98bc-4a92-add8-cd1a7199005f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.299316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 51/99] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:05.304392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.304678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.304955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.315379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 49/100] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:05.337615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:05.338821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:05.383382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:05.419934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 52/101] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 03 12:05:05.459270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:05.549141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536529-ab01-419f-abec-0ea944b6c52a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:05.581995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b263fff-8d34-4761-9c86-a2b8589558de None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:05.612134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:05.612982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.613269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.613548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.614743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:05.616340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:05.618211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 50/102] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:05.625749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:05.626572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.626853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.627124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.629245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:05.638654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:05.647273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:05.648132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:05.648919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:05.651396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 53/103] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:05.657783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:05.731325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a08283-41a8-43d1-94bd-0fa147d9fff0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:05.767466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:05.768517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.769028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.769507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.770438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:05.772105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:05.817686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09c346-1455-4ad8-bc8d-dbde6eb02212 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:05.855389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:05.856450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.856963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.857501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.858517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:05.859020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:05.860691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ebf37-57c3-40ce-84a6-ec65b3ddf3fe None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:05.870803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 51/104] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:05:05 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:05:05.878835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 54/105] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:05.884429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:05.899882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531842fa-4d0d-4cef-855b-3fe7a4e46498 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.902209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531842fa-4d0d-4cef-855b-3fe7a4e46498 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.902693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531842fa-4d0d-4cef-855b-3fe7a4e46498 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.904355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 55/106] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:05.911607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:05.912215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:05.912718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:05.952737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:05.955540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:06.102039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 56/107] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:06.113114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07126e-8bbd-4255-915f-bc8ddcdf058a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.129213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.180393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.181302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.181739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.182160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] PATH_INFO: `/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.209323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] RBAC: Authorizing `identity:get_user(user_id=61a1c40b8ef345c19d761ee25dc2c8f7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.210848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.216927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 52/108] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:05 2022] GET /identity/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7 => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:06.222675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.239581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f50ee7-7af1-45c7-8b5c-be2e1e25a577 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.276807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.278031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.278538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.279012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.289925 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-f9a7ccb6-b145-4579-905c-5f2d7a87df83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:06.298552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:06.299418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:06.300164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:06.302997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 57/109] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:06.304536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798efe-d37c-4945-9d0d-59b7cbfd0f82 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.305042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798efe-d37c-4945-9d0d-59b7cbfd0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.305489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798efe-d37c-4945-9d0d-59b7cbfd0f82 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.307117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 58/110] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:06.321121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798efe-d37c-4945-9d0d-59b7cbfd0f82 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.346319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e353c-24cb-4bd2-9747-2bfad366665c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.381157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.382032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.382642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.383118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.419077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798efe-d37c-4945-9d0d-59b7cbfd0f82 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.453334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.454899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.455735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.455902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.456319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.456802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.457701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:06.458203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.459831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c940e-5ae7-4d91-8fc5-c42018ea972b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.469486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 59/111] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:06.471048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.471516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.472019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.489422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:06.490919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:06.564482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 53/112] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:06.565513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.566144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 60/113] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:06.575315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.665956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769052-1248-42e2-a1a0-56c0fe2f9c37 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.693337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5860edd-3ce6-480b-bb87-de5348741404 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.701132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.702279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.702279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.702558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.703853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.705392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.707228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 54/114] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:06.708074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.730242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.731459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.731969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.732482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.733882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.736095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.738145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 61/115] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:06.739126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.811741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb7bf-bed1-4e36-8bcc-25d16df296c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.843415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b5e5-004b-44bd-83cc-9947f9af2115 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:06.846185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.847006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.847289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.848282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.858846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:06.867842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:06.868761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:06.869525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:06.870092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 55/116] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:06.875416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.888489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:06.889728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.890244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.890754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.892310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:06.894024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfebc83-6ed6-451d-988a-e6874aed13c8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:06.896024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 62/117] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:06.897624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931417-695e-4362-a336-d94466dfac2c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:06.898069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931417-695e-4362-a336-d94466dfac2c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:06.898509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931417-695e-4362-a336-d94466dfac2c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:06.900060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 63/118] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:06.901055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab931417-695e-4362-a336-d94466dfac2c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:06.981223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ba226-a4aa-4800-b14c-5a9b44df3781 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.006501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab931417-695e-4362-a336-d94466dfac2c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.015294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.016223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.016223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.016547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.017487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=61a1c40b8ef345c19d761ee25dc2c8f7) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:07.017798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.019254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba557-a70f-4c80-b4e4-92e0ecb21ff0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.028476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 56/119] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/role_assignments?user.id=61a1c40b8ef345c19d761ee25dc2c8f7&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=99fd595923034fffbfed50789bff3d54 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:07.028476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22890-8e84-42e7-a8f8-8a16f5f363e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.028476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22890-8e84-42e7-a8f8-8a16f5f363e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.028476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22890-8e84-42e7-a8f8-8a16f5f363e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.045973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dff22890-8e84-42e7-a8f8-8a16f5f363e8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:07.047908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dff22890-8e84-42e7-a8f8-8a16f5f363e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:07.064794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.065739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.066254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.066679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.067577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:07.072503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.074100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.089083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 64/120] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:07.090182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.143186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 57/121] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:07.144962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf770-a63a-46d2-8c85-5a4320c45492 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.145504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf770-a63a-46d2-8c85-5a4320c45492 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.145934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf770-a63a-46d2-8c85-5a4320c45492 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.148280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 58/122] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:07.150012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf770-a63a-46d2-8c85-5a4320c45492 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.233310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30ca9-a3bc-4445-b526-45e203f3b98d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.278430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf770-a63a-46d2-8c85-5a4320c45492 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.282548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.283899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.284329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.284793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/686a67a5c5504371ad3aa3729db69baf/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.287451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, user_id=686a67a5c5504371ad3aa3729db69baf, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.289507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.313647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.314646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.314998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.315343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.316654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.318188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f896c5-2cee-441e-8b5d-1abeb530f78f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.320058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 59/123] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:07.321276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.321653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.321987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.342769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:07.344604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:07.361455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 65/124] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:07 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/686a67a5c5504371ad3aa3729db69baf/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:07.362516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.476350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 60/125] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:07.477399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.536336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064c0ee-aeb1-403a-a7b4-169e8cb03969 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.578108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.580052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.580711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.581484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.598493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:07.609259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:07.610358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:07.611175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:07.614012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 66/126] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:07.615175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.633032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd7f04-d720-4480-ad5a-8f8ea8eaf348 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.673572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.674624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.675078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.675460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.676860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.678678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.680888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 61/127] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:07.681753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.754566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8a58-c7eb-4abc-a850-905e4fb4bd3e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.788509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.789166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.789579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.790026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.800163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:07.802422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f285-1a87-4d71-ab3f-922093defffd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:07.808630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:07.809538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:07.810396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 67/128] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:07.811030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.854578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:07.855262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:07.855547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:07.855822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:07.858703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:07.858977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:07.862226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:07.880544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 62/129] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:07.881417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:07.961809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c2076-1df7-4444-a1d0-a86650e653d5 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.012294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.013205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.013488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.013763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/686a67a5c5504371ad3aa3729db69baf/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.020134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, user_id=686a67a5c5504371ad3aa3729db69baf, role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.021940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.037147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2804c64-0766-4011-bfbb-238501f37f9b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.103684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.103684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.103684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.103684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.104274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:08.104274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.104274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.104274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 63/130] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:08.104274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.197315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24497354-71ff-47ad-8f1c-67250e61f795 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.229643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 68/131] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:07 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/686a67a5c5504371ad3aa3729db69baf/roles/d718902dd4844e5cade3e242453c139a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:08.230686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.254288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.255199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.256611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.256946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.259487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.264545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.269120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 64/132] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:08 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:08.278884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.421760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448db3-4548-4908-8ae5-f2b379a8c8e8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.494967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.496353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.496883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.497683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.501639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec1a5-8cb5-4e0c-b4f3-56454e7138ae None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.503807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.505488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.507790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 65/133] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:08 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:08.513537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.554636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.555582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.555805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.556079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.557917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.559377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.563940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 69/134] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:08 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:08.569496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.691280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2005-b091-4092-8141-d89a2e13d39b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.740351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd521-b0c2-45a5-aa4a-cf63923048d8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.773104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.774018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.774304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.774579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/999bb4f35c6e4023831d5433d656d3cf/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.776685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, user_id=999bb4f35c6e4023831d5433d656d3cf, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.778150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdc645-4ed3-459f-ad15-6962df8d1e9c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.795237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.796113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.796417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.796747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] PATH_INFO: `/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.798609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] RBAC: Authorizing `identity:get_project(project_id=fbe8b9c9ec5a4ed5a5b113db0072943e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.800186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:08.801967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 70/135] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:08 2022] GET /identity/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:08.808064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:08.869286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 66/136] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:08 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/999bb4f35c6e4023831d5433d656d3cf/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:08.937403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bc9a-7a04-414f-bf1a-e6602eaa0054 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:08.982032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:08.982912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:08.983203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:08.983484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] PATH_INFO: `/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e/users/686a67a5c5504371ad3aa3729db69baf/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:08.986563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbe8b9c9ec5a4ed5a5b113db0072943e, user_id=686a67a5c5504371ad3aa3729db69baf, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:08.988023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607e5ce-4752-47dc-8fed-b9ad685f7837 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:09.058835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 71/137] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:08 2022] PUT /identity/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e/users/686a67a5c5504371ad3aa3729db69baf/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:05:09.408087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474491c-7249-44b3-829d-fde5e298958a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:09.409256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474491c-7249-44b3-829d-fde5e298958a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:09.409749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474491c-7249-44b3-829d-fde5e298958a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:09.411348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 67/138] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:09.417565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:09.418104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:09.418592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:09.441036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:09.442575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:09.534485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 72/139] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:09.580532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474491c-7249-44b3-829d-fde5e298958a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:09.705143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474491c-7249-44b3-829d-fde5e298958a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:09.743411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:09.744606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:09.745109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:09.745583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:09.747003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:09.748701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6370c4-5218-4311-bd56-c6026c8cfc15 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:09.751189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 68/140] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:09.756847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:09.886182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eb88d-86f3-4e78-8c5c-43072bf7717a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:09.925992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:09.926668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:09.926952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:09.927230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:09.928213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:09.929696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3064c-b021-43f1-a3de-198e299b5770 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:10.049646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 73/141] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:09 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:10.258605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59667-c6a2-4a54-b2d2-874e0bb6efc2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.259283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59667-c6a2-4a54-b2d2-874e0bb6efc2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.259794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59667-c6a2-4a54-b2d2-874e0bb6efc2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.261479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 69/142] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:10.267529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.268069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.268581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.291007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:10.292635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:10.385564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 74/143] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:10.417733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59667-c6a2-4a54-b2d2-874e0bb6efc2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:10.542070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59667-c6a2-4a54-b2d2-874e0bb6efc2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:10.582443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:10.583253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.583544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.583819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.598377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8a357153-f7a6-467d-9025-cf304dd3aa00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:10.606753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:10.607683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:10.608905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 70/144] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:10.613989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:10.717216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b742-4f12-4613-ab03-888498a5d9da None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.717526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b742-4f12-4613-ab03-888498a5d9da None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.717782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b742-4f12-4613-ab03-888498a5d9da None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.719379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 71/145] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:10.724916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.725202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.725485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.736524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b43e-4ab7-4fff-9db9-79b6a41f11c3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:10.746598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:10.747812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:10.811866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:10.813099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:10.813387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:10.813660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:10.814419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:10.814726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:10.816120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:10.829168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 75/146] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:10.837803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:10.862203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 72/147] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:10.897443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:10.981063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb179c9-78ac-49f4-bd72-7247716c8dbe None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.023426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.024321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.024639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.024923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] PATH_INFO: `/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.029861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] RBAC: Authorizing `identity:get_user(user_id=61a1c40b8ef345c19d761ee25dc2c8f7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:11.031414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:11.033325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 76/148] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:10 2022] GET /identity/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:11.039151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:11.092260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74b14e-4fa5-483c-a295-cb9725725c16 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.133178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.134332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.134769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.135187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.155965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:11.163954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:11.164893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:11.165653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:11.171421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 73/149] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:11.180967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:11.236319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb1c7-89f9-4384-8c8d-6aecbfdb81e3 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.306570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.307542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.320402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.320402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.320402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:11.320402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:11.320402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 77/150] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:11 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:11.322365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:11.378000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e392d-ea02-4f5b-ae32-7f984d44993e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.453521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.454134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.454395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.454672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.455437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:11.455742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:11.457160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:11.479892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 74/151] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:11.485770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:11.506958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eed65-02f5-4940-b3c2-ef248f991bfb None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.554708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.556907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.560268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.560761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/61a1c40b8ef345c19d761ee25dc2c8f7/roles/99fd595923034fffbfed50789bff3d54` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.570636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, user_id=61a1c40b8ef345c19d761ee25dc2c8f7, role_id=99fd595923034fffbfed50789bff3d54)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:11.572341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:11.637794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b184-1e59-4a43-9a86-ea6a62941206 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.669475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 78/152] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:11 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/users/61a1c40b8ef345c19d761ee25dc2c8f7/roles/99fd595923034fffbfed50789bff3d54 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:11.688543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.689744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.690174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.690657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.692235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:11.694033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a47e22-32ed-4ba5-a915-8930315f308f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:11.697220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 75/153] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:11 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:11.702832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:11.754050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d3-7424-41a1-8163-2aafe686129a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.754647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d3-7424-41a1-8163-2aafe686129a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.755142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d3-7424-41a1-8163-2aafe686129a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.756816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 76/154] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:11.763736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.764570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.765065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.801632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:11.803107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:11.864580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290780b-3363-4c2e-bcd4-75781f97f67d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:11.907144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 77/155] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:11.913163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:11.914099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:11.914531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:11.914952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:11.945109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.000545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:12.002052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:12.094746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ac98-3323-4464-a8ea-fc68c42a3ab4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:12.123534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 79/156] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:12.128841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.158204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:12.159034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.159319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.159587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.191624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-653183c9-9888-41bf-8dc0-81ed46ebb11d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:12.199788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:12.200687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:12.201458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:12.205417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 78/157] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:12.206719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73443de-e962-4bd4-9821-af70bf9d6157 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.207003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73443de-e962-4bd4-9821-af70bf9d6157 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.207276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73443de-e962-4bd4-9821-af70bf9d6157 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.208762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 79/158] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:12.214538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73443de-e962-4bd4-9821-af70bf9d6157 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.247235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08560a-f677-41ea-87e6-68736506298f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:12.293101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:12.293984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.294263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.294556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.295786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:12.297490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2a6c0-cfde-4225-8dd2-5bdc0f7c143e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:12.299400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 80/159] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:12 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:12.300397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.300691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.300953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.329607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:12.332588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:12.442673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 81/160] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:12.443351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.502050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73443de-e962-4bd4-9821-af70bf9d6157 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:12.560970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:12.561645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.561928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.562204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.563746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:12.564049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:12.565474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:12.584727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 80/161] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:12.585579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.624133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7da6-22f4-426c-bf15-a3dc13e0d908 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:12.690571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:12.691289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.691511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.691765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.692621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:12.692928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:12.696901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a9a3-1533-41b9-a040-56fa5efd7e57 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:12.710853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 82/162] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:12 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:12.717261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f816c-b15a-4214-8ac0-cd2828fbc60d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.717551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f816c-b15a-4214-8ac0-cd2828fbc60d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.717830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f816c-b15a-4214-8ac0-cd2828fbc60d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.721720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 83/163] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:12.723652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f816c-b15a-4214-8ac0-cd2828fbc60d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:12.784955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41659-cd81-4592-a10c-50c70092bb41 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:12.840806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:12.841808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.842101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.842425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.865258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4277ca56-76c1-46ce-b3f2-f7fffea11e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:12.877644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:12.878513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:12.879301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:12.880671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 81/164] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:12.881954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:12.884401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:12.884401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:12.917549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:12.919526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:12.985505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f816c-b15a-4214-8ac0-cd2828fbc60d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.061796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.062740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.063020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.063294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.069209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.070695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.072437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 84/165] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:12 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:13.073216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.085242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 82/166] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:13.085935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.250561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619ada7-268a-4ae5-851c-6aca57310eef None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.286728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0caf5a-3f76-458c-b92d-ff3a731ba75b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.289015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.289694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.289975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.290249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.291011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:13.291304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.292706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.303225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 85/167] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:13.303857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.384188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.384880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.385160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.385439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.416761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991325-9fa8-48a3-87b6-55a9c7fc21da None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.460485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.461476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.462070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.462362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.469773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.471269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.476803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:13.486664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:13.487545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:13.488764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 86/168] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:13.490371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.592153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 83/169] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:13.592815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.610273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642ce4-3441-41cd-b7fe-e7a5ed576953 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.645268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.646145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.646425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.646698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] PATH_INFO: `/v3/users/999bb4f35c6e4023831d5433d656d3cf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.647909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] RBAC: Authorizing `identity:get_user(user_id=999bb4f35c6e4023831d5433d656d3cf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.649406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.651244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 87/170] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/users/999bb4f35c6e4023831d5433d656d3cf => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:13.651797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.701533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36287f-c96f-4d42-bfb7-f6af40927305 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.745093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.745770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.746054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.746329 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.747144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:13.747502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.751477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.767005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 84/171] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:13.767752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.805372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9736a-85c0-43bb-a626-f1416e1d8220 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.854003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.854864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.855147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.855422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:13.859311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:13.860832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:13.866032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 88/172] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:13.867932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:13.942317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37b15-5fd8-4b6d-a57c-9a1779349e57 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:13.975928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:13.977486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:13.977767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:13.978038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.059405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7962e9-1a1d-4261-895e-8323e16fe7e5 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:14.101893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.103370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.123684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:14.124538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:14.125452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:14.125744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] PATH_INFO: `/v3/users/686a67a5c5504371ad3aa3729db69baf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.128315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] RBAC: Authorizing `identity:get_user(user_id=686a67a5c5504371ad3aa3729db69baf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.129796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.134032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 89/173] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/users/686a67a5c5504371ad3aa3729db69baf => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:14.134811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:14.266366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 85/174] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:14.267245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:14.358173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c45f-1a3b-49d8-8751-a4fbe36ebb10 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:14.423918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:14.424545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:14.424830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:14.425102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.425946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:14.426262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.427969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.440053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 90/175] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:14 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=d718902dd4844e5cade3e242453c139a => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:14.440930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:14.462110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001095e-c62d-47c0-94fb-9189dbce3d95 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:14.529157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:14.529811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:14.530094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:14.530426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.622346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81eee9-9742-41c3-9ac2-10296653a110 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:14.634503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.636733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.687977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:14.688804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:14.689091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:14.689369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.690668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.692212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.694011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 91/176] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:14 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:14.700028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:14.762339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 86/177] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:14.769692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:14.904433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3134-e033-4cd5-b91a-b6826b047e0d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:14.954978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:14.955594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:14.955873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:14.956146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:14.957045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=999bb4f35c6e4023831d5433d656d3cf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:14.958375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:14.959944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:14.969676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 92/178] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:14 2022] GET /identity/v3/role_assignments?user.id=999bb4f35c6e4023831d5433d656d3cf&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:14.976398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d6b7a-e25c-481a-a78e-fb03e9d0a41c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.014628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.016290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.016740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.017189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] PATH_INFO: `/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.018556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] RBAC: Authorizing `identity:get_project(project_id=fbe8b9c9ec5a4ed5a5b113db0072943e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:15.020214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b75b2-645f-47c9-8ee0-2e921f389840 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:15.022709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 87/179] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:14 2022] GET /identity/v3/projects/fbe8b9c9ec5a4ed5a5b113db0072943e => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:15.028144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.142331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f255f39-e6b4-4958-8731-772f0fb45a3a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.181776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.182696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.183125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.183547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.184612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=fbe8b9c9ec5a4ed5a5b113db0072943e, user.id=686a67a5c5504371ad3aa3729db69baf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:15.185078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:15.186744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01da7e5-a9cc-4c70-8e18-262950556a0e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:15.197777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 93/180] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/role_assignments?user.id=686a67a5c5504371ad3aa3729db69baf&scope.project.id=fbe8b9c9ec5a4ed5a5b113db0072943e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:15.327285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940945-362a-4214-af58-c05503434740 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.328674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940945-362a-4214-af58-c05503434740 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.329169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940945-362a-4214-af58-c05503434740 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.331245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 88/181] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:15.336547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdcca-3a86-46a7-8c43-9326085bcfea None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.337162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdcca-3a86-46a7-8c43-9326085bcfea None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.337661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdcca-3a86-46a7-8c43-9326085bcfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.356831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ee8bdcca-3a86-46a7-8c43-9326085bcfea None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:15.364865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ee8bdcca-3a86-46a7-8c43-9326085bcfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:15.424131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9845b3-78f0-4914-b364-ee7ccea263f9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.424513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9845b3-78f0-4914-b364-ee7ccea263f9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.424795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9845b3-78f0-4914-b364-ee7ccea263f9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.426196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 89/182] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:15.433333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.433950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.434428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.462575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:15.465800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:15.529775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 94/183] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:15.531670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9444-433f-4478-8702-2c8acfb45fdc None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.532189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9444-433f-4478-8702-2c8acfb45fdc None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.532661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9444-433f-4478-8702-2c8acfb45fdc None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.534432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 95/184] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:15.540572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.541103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.541540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.561481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:15.563633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:15.564803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 90/185] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:15.569387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.646105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 96/186] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:15.647338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.696613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2248a5-eee7-4bd5-be0f-fa588472face None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.735229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.736026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.736310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.736620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.745557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf578fb-2274-4db6-a475-8fd9fb6fb638 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.746541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:15.754902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:15.755851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:15.756671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 91/187] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:15.757776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.778289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.779099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.779377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.779649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.789851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3fe77190-c169-4680-aa31-86c5054759a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:15.798560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:15.799571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:15.800349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 97/188] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:15.801032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbf5-c476-4718-9952-f91988194ae5 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.801247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbf5-c476-4718-9952-f91988194ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.801512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbf5-c476-4718-9952-f91988194ae5 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.803015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 98/189] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:15.805043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ecbf5-c476-4718-9952-f91988194ae5 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.859104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09998-2827-41dd-b496-9b25842efa1d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.891448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.892230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.892539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.892813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.899814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ecbf5-c476-4718-9952-f91988194ae5 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:15.902361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:15.910646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:15.911516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 92/190] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:15.917037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:15.932151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:15.932840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.933231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.933519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.934266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:15.934571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:15.935950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6a5b-6ba6-4db2-b5ad-1414f8060b64 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:15.944111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 99/191] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:15.945309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:15.945590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:15.945868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:15.960872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:15.962032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:16.005567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02fef0-9278-4736-a1ff-410484f7960c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.023872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 100/192] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:16.025061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.041971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.042632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.042911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.043183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.043926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:16.044230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.045634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.054575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 93/193] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.056424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.125765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691fac0-453c-4050-bcdc-873d313189a0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.154107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9e874-5508-424c-8fd9-372aef74ecd5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.172042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.172732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.173010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.173276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.174026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:16.174323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.175697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.184133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 101/194] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.184886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.194604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.195484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.195765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.210219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.211692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.216495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 94/195] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.216495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.289638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf72bc-db51-46e4-8d5f-f2446a3182bd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.315702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da6-5621-4114-863b-2c3040eb324c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.324108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.324937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.325274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.325547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.326727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.328779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.330594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 102/196] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.335706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.357206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.358204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.358824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.358824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.360054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.361537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.363239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 95/197] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.363998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.437582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2dd3-b177-4851-b877-a4fd07a0f1ef None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.457117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142cee-c2c0-4774-bdbb-fc9a0471bebd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.469006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.469958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.470260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.470528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] PATH_INFO: `/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.471689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] RBAC: Authorizing `identity:get_user(user_id=61a1c40b8ef345c19d761ee25dc2c8f7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.473166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.474757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 103/198] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/users/61a1c40b8ef345c19d761ee25dc2c8f7 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:16.475480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.493346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.493986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.494262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.494562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.558061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.559521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.565598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e644-158a-43ba-9dd8-0f1a27dfc993 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.605200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.606163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.606593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.607039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.608134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.610444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.651494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 96/199] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:16.652449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.680294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 104/200] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:16 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:16.681140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:16.754059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97351f-b47e-453e-8dc0-460330601124 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.787064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723a377-db46-4f6e-8956-2f8b3cc79cf4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:16.788807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.789472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.789745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.790013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.821643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:16.822570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:16.822853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:16.823131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:16.859837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.861330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.898766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:16.900230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:16.974177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 97/201] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:16.975251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.004968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 105/202] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:17.006508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.082449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901b0e3-3c53-418e-b297-79b8f96b9bff None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.110893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7d03-0a81-4764-ac41-e0d11cf7b984 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.117012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.117865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.118141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.118408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.119599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.121103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.122810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 98/203] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:16 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:17.123567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.148329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.149581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.150074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.150544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.151990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.153732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.155636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 106/204] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:17 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:17.157227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.226941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61994a00-8a07-4252-a980-ca5de42c5804 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.258155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7cf0-a841-4c0d-a1ae-2759d4cceea0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.259849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.260745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.261022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.261291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.263003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.264491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.266777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 99/205] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:17 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:17.267550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.295862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.296939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.297437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.297917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.299203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=69291da9311f431cae0071241282637e, user.id=67c820adb844450e8596aad75b207d8b) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:17.299708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.301455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.307405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 107/206] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:17 2022] GET /identity/v3/role_assignments?user.id=67c820adb844450e8596aad75b207d8b&scope.project.id=69291da9311f431cae0071241282637e&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:17.308732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:17.369685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee0b3-d888-46bf-9959-de397655b4af None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.405562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.406251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.406528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.406794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.407612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=69291da9311f431cae0071241282637e, user.id=67c820adb844450e8596aad75b207d8b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:17.407914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.409449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759ec7-d500-4731-976c-7a2b676fbdaa None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.415302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 100/207] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:17 2022] GET /identity/v3/role_assignments?user.id=67c820adb844450e8596aad75b207d8b&scope.project.id=69291da9311f431cae0071241282637e&role.id=d718902dd4844e5cade3e242453c139a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:17.421268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe823a1-a7da-4940-a703-8490c1da9f59 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:17.460837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:17.461945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:17.462436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:17.462920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:17.464024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, scope.project.id=f93de6293d4a4d309937cb9036619ca6, user.id=61a1c40b8ef345c19d761ee25dc2c8f7) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:17.464607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:17.466373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82eae6-9922-4394-b286-13b6a1cb471d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:17.474062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 108/208] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:17 2022] GET /identity/v3/role_assignments?user.id=61a1c40b8ef345c19d761ee25dc2c8f7&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=99fd595923034fffbfed50789bff3d54 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:19.211097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332a60-42d8-4968-badb-bd9c440b6182 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.211615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332a60-42d8-4968-badb-bd9c440b6182 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.211615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332a60-42d8-4968-badb-bd9c440b6182 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.214601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 101/209] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:19.220165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.221007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.221490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.239057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:19.240613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:19.251231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470b3a-e84b-43bc-b6be-cc50530cb528 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.251505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470b3a-e84b-43bc-b6be-cc50530cb528 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.251787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470b3a-e84b-43bc-b6be-cc50530cb528 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.253361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 102/210] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:19.258530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.258817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.259096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.275887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:19.277137 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:19.311718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 109/211] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:19.337379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.345774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 103/212] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:19.369634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.442245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1f25-4b95-4d32-afd7-fa7b3549c61a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.469058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5e18-e844-4f5d-9263-b5d9800d7a58 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.476202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:19.477278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.477781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.478277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.479782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:19.481493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:19.488447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 110/213] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:19.489546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.505112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:19.505950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.506186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.506465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.517065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:19.525079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:19.525956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:19.526749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 104/214] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:19.532875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.595685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877db52-33f3-4828-9aad-3d77f6095424 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.635577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:19.636713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.637246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.637722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.638680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:19.640445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91336f0-59e8-48e8-9aff-0fb9d97a1794 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:19.642574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8cdfe-2cbb-4cd8-82de-e307bcec16dc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.677118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:19.677991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.678273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.678546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.679285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:19.679590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:19.680988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:19.689515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 105/215] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:19.694712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.720638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 111/216] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:19 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:19.786763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ce97-62e0-44c1-948e-c3e7e4d3c85c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.787098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ce97-62e0-44c1-948e-c3e7e4d3c85c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.787333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449ce97-62e0-44c1-948e-c3e7e4d3c85c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.789077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 112/217] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:19.794886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272949-05e6-4571-b6b6-b532c45be83a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.795167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272949-05e6-4571-b6b6-b532c45be83a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.795441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272949-05e6-4571-b6b6-b532c45be83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.806633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d552d-754a-4f10-8a1d-c8792d5fa38d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.813938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0d272949-05e6-4571-b6b6-b532c45be83a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:19.815165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0d272949-05e6-4571-b6b6-b532c45be83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:19.841748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:19.842637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.842925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.843180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] PATH_INFO: `/v3/users/dd9f629b53e049da9ebcdec2f1976a2d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.860920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] RBAC: Authorizing `identity:get_user(user_id=dd9f629b53e049da9ebcdec2f1976a2d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:19.862586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9eb1e-d7d4-42aa-b888-049fa0bc5518 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:19.869317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 106/218] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/users/dd9f629b53e049da9ebcdec2f1976a2d => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:19.869317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f9838-55ae-480d-962d-649af9003f70 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.869317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f9838-55ae-480d-962d-649af9003f70 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.869317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f9838-55ae-480d-962d-649af9003f70 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.869317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 107/219] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:19.870117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f9838-55ae-480d-962d-649af9003f70 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:19.892494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 113/220] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:19.898003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:19.898292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:19.898571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:19.917671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:19.918852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:19.987080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f9838-55ae-480d-962d-649af9003f70 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:19.997754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 114/221] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:19.998330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.035653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.036309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.036621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.036891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.120000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.122094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.123210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604404-553c-4db5-8c2a-4331648b5321 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.168127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.169085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.169529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.169802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.183826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:20.194342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:20.195237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:20.196039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 115/222] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:20.196717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.228377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 108/223] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:20.229249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.299118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce06e-e869-4c8a-8a0c-72d56d7eaf87 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.327214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82250ea7-45e1-44a7-8254-be6401db8f96 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.338484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.339407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.339756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.340093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.353733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:20.361369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:20.361738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:20.362580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:20.363386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:20.363982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.363982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.363982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.364225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 116/224] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:20.364293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:20.364293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.365326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.365397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.373972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 109/225] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.374388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.480010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd18f-fc00-4f8f-bacc-05fa59754e62 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.496233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b80a-5c6b-4f2d-83ad-b30105f6b29d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.518916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.520572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.521074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.521741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.523542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.525642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.528799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 117/226] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.529712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.535977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.536813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.537201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.537568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.538419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:20.538822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.540308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.548923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 110/227] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.549993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.650478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383f76b-62cb-410e-ba59-1b058666ee58 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.654671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc0f4-244a-4f0b-99c6-cf27e7a71498 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.688334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.689387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.689533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.689887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.690818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=69291da9311f431cae0071241282637e, user.id=dd9f629b53e049da9ebcdec2f1976a2d) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:20.691227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.693021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.698387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 111/228] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/role_assignments?user.id=dd9f629b53e049da9ebcdec2f1976a2d&scope.project.id=69291da9311f431cae0071241282637e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.698735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.699819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.700232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.700675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.702127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.703874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.705507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.706059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 118/229] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.712164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.842042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a10a0-a769-4c2a-84df-2b7f4eae992e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.860333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd37d6-92a7-431a-86a4-3c5310fb1b1f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:20.879447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.880615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.881070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.881489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.882899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.884702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.886869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 112/230] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.892450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:20.917358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:20.918488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:20.919577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:20.919867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:20.922309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:20.924387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:20.931696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 119/231] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:20.933323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:21.049495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39756e9f-c203-4412-adc8-a9ef4551604e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:21.067972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fa74-d9e8-4e4b-a6d8-2e3f769072f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:21.093664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:21.094493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:21.094774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:21.095047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/users/67c820adb844450e8596aad75b207d8b/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:21.099752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, user_id=67c820adb844450e8596aad75b207d8b, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:21.103404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cfe70-51f0-4801-8ce5-d473d9cd6056 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:21.125009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:21.125880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:21.130955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:21.130955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:21.130955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:21.130955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:21.130955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 113/232] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:20 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:21.136551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:21.194829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 120/233] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:20 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/users/67c820adb844450e8596aad75b207d8b/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:21.251572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc89ce-739f-44f9-a10c-64e7bc09758b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:21.287042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:21.288000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:21.288288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:21.288623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/users/67c820adb844450e8596aad75b207d8b/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:21.290897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, user_id=67c820adb844450e8596aad75b207d8b, role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:21.292422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921064a-bd6f-4798-9ab5-a410b74f23ae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:21.383683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 114/234] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:21 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/users/67c820adb844450e8596aad75b207d8b/roles/d718902dd4844e5cade3e242453c139a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:05:22.302164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5353-ce70-443e-9c64-9f2e76387101 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.302938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5353-ce70-443e-9c64-9f2e76387101 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.302938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5353-ce70-443e-9c64-9f2e76387101 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.304500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 121/235] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:22.309948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.310752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.311313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.329136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:22.335710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:22.418889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 115/236] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:22.463109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107c2e-c054-45db-a49f-c4c43bf41e71 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.463411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107c2e-c054-45db-a49f-c4c43bf41e71 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.463667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107c2e-c054-45db-a49f-c4c43bf41e71 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.465076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 122/237] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:22.467778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:22.470136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.470664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.471141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.497765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:22.499273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:22.568221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d2ea-e040-4f62-8ade-728ed7af93b0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:22.602360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:22.603953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.604404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.604838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.622467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:22.630570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:22.631614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:22.632534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:22.644859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 116/238] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:22.650983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 123/239] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:22.653549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:22.688063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:22.775444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9493c-6b32-4989-8f04-0202aedea661 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:22.815500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:22.816618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.817046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.817466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.818405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:22.818856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:22.820440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:22.829969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 117/240] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:22.836169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:22.907069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dd522-1fd0-4eb3-987f-0990491b3924 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:22.946188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db75eb-5384-46f5-9292-e6eaaa06f592 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:22.981904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:22.983154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:22.983578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:22.984018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] PATH_INFO: `/v3/users/933b21c761e147b5856c1eeca0c91704` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:22.998722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] RBAC: Authorizing `identity:get_user(user_id=933b21c761e147b5856c1eeca0c91704)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.000529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.002285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.003120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.003559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.004023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.007078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 118/241] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:22 2022] GET /identity/v3/users/933b21c761e147b5856c1eeca0c91704 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:23.008387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:23.009057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.010505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.012389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 124/242] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:23.017790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:23.116915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43bfae-af8d-470d-a4f2-4a7ac92d55ab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:23.154760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.155413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.156259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.156562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.208270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34423353-d1cf-43dd-907b-88f12053057b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:23.231234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.233037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.276691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.277382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.277660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.277931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.278650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.280114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.366709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 119/243] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:23.368088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:23.467405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee140db-c16d-4e8b-b369-ddd5ab43512f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:23.503419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.508595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.508595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.508595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.508595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.508595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b18a0d-4830-4d4f-82a1-88269c6e01ef None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.512463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 120/245] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:23 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:23.512463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badbd0-d8a1-4066-8d5b-9e7a2f8de8fd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.512463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badbd0-d8a1-4066-8d5b-9e7a2f8de8fd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.512463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badbd0-d8a1-4066-8d5b-9e7a2f8de8fd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.512778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 121/246] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:23.513234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 125/246] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:23 2022] POST /identity/v3/users => generated 293 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:05:23.518980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.519270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.519554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.532478 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:23.541130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:23.543361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:23.669165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 122/247] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:23.731402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa48c0-c599-4b28-840b-7ac3b973a696 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:23.741329 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:23.788044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.789079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.789567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.790041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.791093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, scope.project.id=69291da9311f431cae0071241282637e, user.id=933b21c761e147b5856c1eeca0c91704) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:23.791632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:23.793733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:23.809109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 126/248] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:23 2022] GET /identity/v3/role_assignments?user.id=933b21c761e147b5856c1eeca0c91704&scope.project.id=69291da9311f431cae0071241282637e&role.id=99fd595923034fffbfed50789bff3d54 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:23.891026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c7f50-4a71-4378-bd29-43c6356dc137 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:23.936322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:23.937704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:23.937987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:23.938259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:23.955017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4b4e59f3-7181-4b65-993a-83cad371f82f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:23.963142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:23.964079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:23.965136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 123/249] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:23.972207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.089203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34106d0f-5ef0-406f-b8f4-9eb5939fe89a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.092724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34106d0f-5ef0-406f-b8f4-9eb5939fe89a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.093216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34106d0f-5ef0-406f-b8f4-9eb5939fe89a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.094651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 124/250] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:24.100983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46d66-b20d-4ad9-82d7-035a22120679 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.101271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46d66-b20d-4ad9-82d7-035a22120679 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.101551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46d66-b20d-4ad9-82d7-035a22120679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.102614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9f09-0938-4e40-8fc9-38b6d05c259e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.126927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-18b46d66-b20d-4ad9-82d7-035a22120679 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:24.128232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-18b46d66-b20d-4ad9-82d7-035a22120679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:24.142106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.142782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.143067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.143346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.144097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:24.144433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:24.145813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff568e8-84e1-49f7-9d4a-674696951f34 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:24.154973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 127/251] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:24.156315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3225f-eebd-4841-a5db-57dfe5b23dee None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.156635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3225f-eebd-4841-a5db-57dfe5b23dee None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.156911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3225f-eebd-4841-a5db-57dfe5b23dee None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.158169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 128/252] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:24.167419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3225f-eebd-4841-a5db-57dfe5b23dee None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.224889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 125/253] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:24.226202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.226497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.226776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.262103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:24.263301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:24.291918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3225f-eebd-4841-a5db-57dfe5b23dee None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.326579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.328013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.328349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.328652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] PATH_INFO: `/v3/users/dd9f629b53e049da9ebcdec2f1976a2d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.335124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] RBAC: Authorizing `identity:get_user(user_id=dd9f629b53e049da9ebcdec2f1976a2d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:24.336741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:24.338825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 129/254] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/users/dd9f629b53e049da9ebcdec2f1976a2d => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:24.339716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.355256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 126/255] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:24.355962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.463776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec3b2a-37b3-4a3a-8f90-ce4a35dc184e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.505070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.506199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.506686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.507162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.530043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:24.540705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:24.541608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:24.542390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:24.555262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 130/256] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:24.556297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.572018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a360cf-8378-4ba1-9f60-1afe0f16ac1f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.617262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.618349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.618766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.619173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.620820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:24.622840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:24.625550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 127/257] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:24.626451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.736349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d730bf-ffbf-4895-96b2-677d825550dd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.764132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd31b0-45f3-4cf7-988b-56d819c22d92 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.797691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.798487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.798769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.799048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.809375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:24.810227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:24.810341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:24.810735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:24.811161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:24.812085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:24.812540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:24.814069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:24.818286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:24.819314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:24.820281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 131/258] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:24.824629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.835663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 128/259] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:24.836692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:24.963644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9addbe-6bed-4455-be32-b78cd8a66ae9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:24.975732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f521-4f5b-40f5-8375-e1e3fa252b42 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.006847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.007861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.008385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.008858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.009815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:25.010311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.011882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.021136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.021491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 129/260] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:25.021973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.022256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.022532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/users/dd9f629b53e049da9ebcdec2f1976a2d/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.023182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.024679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, user_id=dd9f629b53e049da9ebcdec2f1976a2d, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.026301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.111661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 132/261] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:24 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/users/dd9f629b53e049da9ebcdec2f1976a2d/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:25.117216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.148638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0406f2-949a-48e0-8f00-2e2b53092bf5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.215238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.217306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.217306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.217306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.224399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.224399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.224797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 130/262] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:25.231013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.362827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20848b90-74ea-4297-9a0c-facdd2394b56 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.366404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378313f-771a-4dfa-92b5-97c2dcfb4858 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.400629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.401682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.402157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.402621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.470934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.471880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.472098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.472388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] PATH_INFO: `/v3/users/67c820adb844450e8596aad75b207d8b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.473306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.474973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.477103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] RBAC: Authorizing `identity:get_user(user_id=67c820adb844450e8596aad75b207d8b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.478649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.480245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 133/263] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/users/67c820adb844450e8596aad75b207d8b => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:25.485952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.575996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 131/264] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:25.582705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.613373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead3dc-978b-47b8-8cf4-67ba18ba83f1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.655009 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.655714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.656015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.656276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.684882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab26ad4-c622-4d77-a0c7-793a8d0eadc6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.719498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.720746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.721242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.721712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.723086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.724753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.726994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 132/265] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:25.732799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:25.759824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.761312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.831957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5072-15e1-4580-9196-5e0230300037 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:25.865164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:25.866183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:25.866656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:25.867121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:25.868130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=69291da9311f431cae0071241282637e, user.id=67c820adb844450e8596aad75b207d8b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:25.868677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:25.870327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:25.877011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 133/266] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/role_assignments?user.id=67c820adb844450e8596aad75b207d8b&scope.project.id=69291da9311f431cae0071241282637e&role.id=d718902dd4844e5cade3e242453c139a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:25.899486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 134/267] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:25.909730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:26.069471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c595-4a45-4097-9e25-a77f1ac543fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:26.115260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:26.116064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.116348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.116650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.121098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:26.122544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d04d-b877-41b7-8afd-4b4621cb0356 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:26.124466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 134/268] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:25 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:26.130209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:26.275379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fea71-c479-4b76-a511-0862a017c785 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:26.313911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=69291da9311f431cae0071241282637e, user.id=67c820adb844450e8596aad75b207d8b) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:26.325068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a93e3-ee69-4464-8028-81a1d478807e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:26.327728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 135/269] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:26 2022] GET /identity/v3/role_assignments?user.id=67c820adb844450e8596aad75b207d8b&scope.project.id=69291da9311f431cae0071241282637e&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:26.768032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c770-4ae0-4f21-b8ea-c9fb0cfce0af None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.768582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c770-4ae0-4f21-b8ea-c9fb0cfce0af None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.768582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89c770-4ae0-4f21-b8ea-c9fb0cfce0af None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.770253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 135/270] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:26.775573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.775994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.776167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.793804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:26.796532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:26.856693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670b16-bb10-4658-b732-4ae28947ac76 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.856693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670b16-bb10-4658-b732-4ae28947ac76 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.856693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670b16-bb10-4658-b732-4ae28947ac76 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.856693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 136/271] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:26.861754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:26.862042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:26.862317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:26.880854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:26.882403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:26.884230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 136/272] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:26.910219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:26.961058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 137/273] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:26.987392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.024204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9867-1629-4ae5-b81e-8bd3e65c3b1a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.057651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.058450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.058728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.058997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.069089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-826f4b60-e625-40c2-99bf-08f629bfde05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:27.076829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:27.077750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:27.078536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 137/274] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:27.079728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a93e-2555-4da9-85f4-427daaabe179 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.080000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a93e-2555-4da9-85f4-427daaabe179 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.080261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a93e-2555-4da9-85f4-427daaabe179 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.081694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 138/275] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:27.085218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662a93e-2555-4da9-85f4-427daaabe179 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.091590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27303fa2-7e79-45c9-a4f3-cf5ab48c414c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.126538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.127439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.127726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.128000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.129191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.130710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33678fd7-bc7c-4177-b4df-cc33e0bea731 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.132463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 138/276] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:27.133406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.133687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.133958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.150468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:27.151695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:27.192496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662a93e-2555-4da9-85f4-427daaabe179 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.221113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 139/277] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:27.225617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.226286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.226569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.226841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.228208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:27.228550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.229937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.233209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.244002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 139/278] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:27.245041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.339932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8b55d-258d-452f-a425-5f1c828ee795 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.344143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ff0-64d9-4682-96e0-5e704395c903 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.375932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.376750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.377035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.377300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.377801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.377994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.378661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.378939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.379213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] PATH_INFO: `/v3/users/933b21c761e147b5856c1eeca0c91704` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.379417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.380416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] RBAC: Authorizing `identity:get_user(user_id=933b21c761e147b5856c1eeca0c91704)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.381873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.388689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 140/279] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/users/933b21c761e147b5856c1eeca0c91704 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:27.388689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.488396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 140/280] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:27 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:27.488396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.494594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe936d94-a451-455c-b1e7-e38e4d4b86b4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.552530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.553352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.553636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.553902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.567451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:27.575469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:27.576466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:27.578025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 141/281] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:27.585794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.613953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c78a-6ed7-4bc7-b98f-b08c24791ca0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.660355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.661258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.661535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.661802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.663052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.664543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.671773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 141/282] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:27.674250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.697383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f38f-7d88-4564-bb7f-5fe36c4da05f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.735036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.735691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.735967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.736239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.737011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:27.737310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.738677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.752103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 142/283] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:27.757875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:27.796200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e98f-e600-4612-8621-8316f2de2662 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.830569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.831456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.831734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.832005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/users/933b21c761e147b5856c1eeca0c91704/roles/99fd595923034fffbfed50789bff3d54` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.834029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, user_id=933b21c761e147b5856c1eeca0c91704, role_id=99fd595923034fffbfed50789bff3d54)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.835526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.870492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f643f-47bd-45a5-82c0-7064222b6275 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:27.906577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:27.907666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:27.907953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:27.908383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] PATH_INFO: `/v3/users/66db88115c2246b29453ecbbc737addc` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:27.925098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 142/284] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:05:27 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/users/933b21c761e147b5856c1eeca0c91704/roles/99fd595923034fffbfed50789bff3d54 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:27.942815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=66db88115c2246b29453ecbbc737addc)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:27.944560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203b991-4c5d-4c8a-81ba-11a142251ff7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:27.946733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 143/285] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/users/66db88115c2246b29453ecbbc737addc => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:27.953443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:28.063750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e39-cde6-4b53-a9ed-dc8849eeb408 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:28.103729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:28.104520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:28.104803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:28.105075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:28.105978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, user.id=66db88115c2246b29453ecbbc737addc, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:28.106291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:28.107768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bfa11-0908-40e2-8a2e-244e7f3adfe4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:28.113959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 143/286] 10.222.0.21 () {56 vars in 1308 bytes} [Tue May 3 12:05:27 2022] GET /identity/v3/role_assignments?user.id=66db88115c2246b29453ecbbc737addc&scope.system=all&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:28.375780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368f2e-3cfb-4a97-80c6-d32c4616e456 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:28.376093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368f2e-3cfb-4a97-80c6-d32c4616e456 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:28.376325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368f2e-3cfb-4a97-80c6-d32c4616e456 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:28.377992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 144/287] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:28.383184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:28.383473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:28.383750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:28.401538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:28.402721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:28.479895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 144/288] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:28.515822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9368f2e-3cfb-4a97-80c6-d32c4616e456 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:28.643865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9368f2e-3cfb-4a97-80c6-d32c4616e456 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:28.687661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:28.688492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:28.688768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:28.689032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:28.705183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:28.712865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:28.713746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:28.714931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 145/289] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:28.722389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:28.862261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9198a8-9c0f-4fa9-b437-5a096f6d5e7a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:28.909623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:28.910215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:28.910506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:28.910781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:28.911523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:28.911828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:28.913223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:28.928348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 145/290] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:28.933969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:29.070587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2a6c-2838-4322-a269-ee051af3cf2a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:29.106480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:29.107713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:29.108192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:29.108844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] PATH_INFO: `/v3/users/dd9f629b53e049da9ebcdec2f1976a2d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:29.110245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=dd9f629b53e049da9ebcdec2f1976a2d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:29.111864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:29.114044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 146/291] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:28 2022] GET /identity/v3/users/dd9f629b53e049da9ebcdec2f1976a2d => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:29.119647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:29.272053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64f70-eb2d-4063-bb3d-4441278a6d04 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:29.318926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:29.319582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:29.319864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:29.320139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:29.411640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:29.413130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:29.535800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 146/292] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:29.541028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:29.694517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d796a7-9dd7-49c0-b2fc-672b1c4db5d6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:29.742461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:29.743340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:29.743619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:29.743891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:29.745127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:29.746569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ea065-9d66-40e1-8202-67a3d328cdc0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:29.748578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 147/293] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:29 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:29.754692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:29.880665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147baed-94cf-4fba-be6d-0f4c9eca387f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:29.933651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:29.934318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:29.934606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:29.934880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:29.935709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=69291da9311f431cae0071241282637e, user.id=dd9f629b53e049da9ebcdec2f1976a2d) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:29.936017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:29.938041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def226b1-2bfd-48af-bed2-adc2863c3303 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:29.949039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 147/294] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:29 2022] GET /identity/v3/role_assignments?user.id=dd9f629b53e049da9ebcdec2f1976a2d&scope.project.id=69291da9311f431cae0071241282637e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:30.239081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6131aa-876b-4fc6-8b4a-d555e18b66fd None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.239929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6131aa-876b-4fc6-8b4a-d555e18b66fd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.240403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6131aa-876b-4fc6-8b4a-d555e18b66fd None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.242251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 148/295] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:30.247597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.248092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.248553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.269477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:30.270693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:30.349604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 148/296] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:30.373525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6131aa-876b-4fc6-8b4a-d555e18b66fd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:30.498374 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6131aa-876b-4fc6-8b4a-d555e18b66fd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:30.536382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:30.537193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.537475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.537748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.548353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7e59c191-08be-4b0a-9650-586fe4e82454 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:30.556636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:30.557509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:30.558287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 149/297] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:30.563945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:30.614647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3b8f-aadd-4958-93f8-8860fe2e0000 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.614930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3b8f-aadd-4958-93f8-8860fe2e0000 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.615206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3b8f-aadd-4958-93f8-8860fe2e0000 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.617097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 150/298] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:30.621790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213b0e-6b7d-44a9-a96d-d2c35697f8c8 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.622070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213b0e-6b7d-44a9-a96d-d2c35697f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.622339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213b0e-6b7d-44a9-a96d-d2c35697f8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.641918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d4213b0e-6b7d-44a9-a96d-d2c35697f8c8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:30.643091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d4213b0e-6b7d-44a9-a96d-d2c35697f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:30.678455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceb163-c207-44be-a330-683cb3c30e5f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:30.716393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 151/299] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:30.716393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c7b26-1de4-4029-a9c4-c27de7f6ab9e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.716393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c7b26-1de4-4029-a9c4-c27de7f6ab9e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.716393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c7b26-1de4-4029-a9c4-c27de7f6ab9e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.716393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 152/300] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:30.718304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:30.719057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.719316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.719412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.719599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.719750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.719892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.720725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:30.721139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:30.722535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:30.735623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 149/301] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:30.736099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:30.736701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:30.737293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:30.806506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 153/302] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:30.807273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:30.842294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389ddf7-2a9d-423c-bbd2-eb672c805c77 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:30.875434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:30.876327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:30.876640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:30.876910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] PATH_INFO: `/v3/users/23de1799348347aeb1f9215c1528c486` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:30.890631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] RBAC: Authorizing `identity:get_user(user_id=23de1799348347aeb1f9215c1528c486)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:30.892875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:30.894571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 150/303] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/users/23de1799348347aeb1f9215c1528c486 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:30.895332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:30.917630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf3716-09ba-494a-9d24-64c8212da204 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:30.951495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.022169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 154/304] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:31.022636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.022707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0e549-a1c7-4265-b5f6-3775ddf1e6de None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.042130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.042932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.043216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.043496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.053893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:31.061926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd08e-4a82-401a-b7d7-79d05f25e29c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:31.062225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:31.063094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:31.063931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:31.068190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 151/305] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:31.068921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.097264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.097913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.098195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.098465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.099291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, user.id=23de1799348347aeb1f9215c1528c486, scope.system=all) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:31.099595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.101049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.116406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 155/306] 10.222.0.21 () {56 vars in 1308 bytes} [Tue May 3 12:05:30 2022] GET /identity/v3/role_assignments?user.id=23de1799348347aeb1f9215c1528c486&scope.system=all&role.id=99fd595923034fffbfed50789bff3d54 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:31.116406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.181574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5a5b-899c-4f3b-a0c5-734ee12755cc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.217656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.218417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.218712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.218985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] PATH_INFO: `/v3/groups` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.219691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.221238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6fe6d-50a5-4edc-9307-55238cfd6405 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.239434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a74a9-fe83-4723-8766-bcede8471be6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.273425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.274102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.274376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.274646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.275405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:31.275706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.277131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21dc0e-9db2-4f57-82a5-05589be51f66 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.285925 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 156/307] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:31.287270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3259-5893-4a40-8c19-89f58a14c876 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.287554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3259-5893-4a40-8c19-89f58a14c876 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.287826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3259-5893-4a40-8c19-89f58a14c876 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.289336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 157/308] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:31.293522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3259-5893-4a40-8c19-89f58a14c876 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.298315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 152/309] 10.222.0.21 () {60 vars in 1134 bytes} [Tue May 3 12:05:31 2022] POST /identity/v3/groups => generated 229 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:31.299909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.301923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.301923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.322228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:31.324928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:31.466710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3259-5893-4a40-8c19-89f58a14c876 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.467717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 153/310] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:31.491279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.504433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.505406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.505692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.505971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] PATH_INFO: `/v3/users/933b21c761e147b5856c1eeca0c91704` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.507948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] RBAC: Authorizing `identity:get_user(user_id=933b21c761e147b5856c1eeca0c91704)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.509464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.511261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 158/311] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/users/933b21c761e147b5856c1eeca0c91704 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:31.516600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.608742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a49b0f-b868-4723-a8e1-ae35a8f23adb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.621658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bab0-e115-4b47-b3b6-b8b82d1598dc None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.643042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.643841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.644120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.644411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.654626 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:31.657555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.658428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.658908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.659367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:31.662524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:31.663364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:31.664145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 154/312] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:31.669679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.732118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.733991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.769674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461715c-ede3-402e-b97b-2c891da12d99 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.803451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.803674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.803757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.804037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.804816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:31.805124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.806496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.815471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 155/313] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:31.820732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.836187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 159/314] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:31.841378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.918471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f8e3-3e9c-4186-9122-9dbb4f0a3ec9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.938467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d8674-f651-46f9-95f4-72afdbea602b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:31.953505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.954377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.954660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.954933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] PATH_INFO: `/v3/users/66db88115c2246b29453ecbbc737addc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.956138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] RBAC: Authorizing `identity:get_user(user_id=66db88115c2246b29453ecbbc737addc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.957604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.959520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 156/315] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/users/66db88115c2246b29453ecbbc737addc => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:31.964902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:31.977884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:31.979206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:31.979716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:31.980562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:31.982174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:31.984752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:31.987526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 160/316] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:31.993847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:32.075347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3a32-7427-46a0-8d5d-011103968e63 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:32.102179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882d83-6445-4952-8b73-aba76cb96aaa None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:32.117450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:32.119232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:32.119669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:32.120095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] PATH_INFO: `/v3/system/users/66db88115c2246b29453ecbbc737addc/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:32.122260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66db88115c2246b29453ecbbc737addc, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:32.124805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064787ed-ce14-4e62-9af8-8b46250583d9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:32.141086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:32.143868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:32.143868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:32.143868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:32.143868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, scope.project.id=69291da9311f431cae0071241282637e, user.id=933b21c761e147b5856c1eeca0c91704) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:32.143868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:32.144932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262a7f-8ec6-4000-b9e2-a0173225bfdb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:32.150965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 161/317] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:31 2022] GET /identity/v3/role_assignments?user.id=933b21c761e147b5856c1eeca0c91704&scope.project.id=69291da9311f431cae0071241282637e&role.id=99fd595923034fffbfed50789bff3d54 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:32.201042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 157/318] 10.222.0.21 () {58 vars in 1334 bytes} [Tue May 3 12:05:31 2022] PUT /identity/v3/system/users/66db88115c2246b29453ecbbc737addc/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:05:33.426782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608287d-0fea-451f-8628-da406ada8acc None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.427544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608287d-0fea-451f-8628-da406ada8acc None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.427642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608287d-0fea-451f-8628-da406ada8acc None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.429140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 162/319] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:33.434106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc06-7f21-42ed-b36f-ec43494682fc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.434501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc06-7f21-42ed-b36f-ec43494682fc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.434661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc06-7f21-42ed-b36f-ec43494682fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.451918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4a29cc06-7f21-42ed-b36f-ec43494682fc None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:33.453115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4a29cc06-7f21-42ed-b36f-ec43494682fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:33.520181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 158/320] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:33.542292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608287d-0fea-451f-8628-da406ada8acc None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:33.639260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608287d-0fea-451f-8628-da406ada8acc None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:33.671523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:33.672321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.672832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.672917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.674192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960c970-4640-46d0-91b6-1cfd8b79071a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.674481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960c970-4640-46d0-91b6-1cfd8b79071a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.674754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960c970-4640-46d0-91b6-1cfd8b79071a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.676267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 159/321] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:33.681024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.681310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.681582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.683533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:33.691911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:33.692825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:33.693781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 163/322] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:33.698740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:33.700615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:33.701849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:33.770835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 160/323] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:33.793631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:33.800053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810da7-a7d3-4214-a83c-040dfe472b43 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:33.833314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:33.833971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.834250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.834520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.835257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:33.835555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:33.836943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:33.845413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 164/324] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:33.850641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:33.889622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be913f-0013-472f-b3ce-34c911b6951f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:33.922967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:33.923766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:33.924047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:33.924322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:33.925536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:33.927328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:33.928995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 161/325] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:33.934623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:33.967078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc9f57-3baa-4b61-8e9f-931d3ff0691b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:34.004043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:34.004932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.005208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.005476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] PATH_INFO: `/v3/users/23de1799348347aeb1f9215c1528c486` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.006651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] RBAC: Authorizing `identity:get_user(user_id=23de1799348347aeb1f9215c1528c486)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:34.008087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:34.010082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 165/326] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:33 2022] GET /identity/v3/users/23de1799348347aeb1f9215c1528c486 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:34.015215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:34.035572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a68f1-04a5-4afd-a6b8-ed32c26df19b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:34.068078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:34.068844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.069118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.069383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.070063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:34.071477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14884fcc-88b1-44f2-9906-b99dd0c655a7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:34.114042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c087-574f-448a-abaa-18505ff8647b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:34.145416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:34.146260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.146531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.146800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] PATH_INFO: `/v3/system/users/23de1799348347aeb1f9215c1528c486/roles/99fd595923034fffbfed50789bff3d54` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.148242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=23de1799348347aeb1f9215c1528c486, role_id=99fd595923034fffbfed50789bff3d54)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:34.149639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1aa22-a333-43de-bbc6-f9ebc31f54ec None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:34.170812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 162/327] 10.222.0.21 () {60 vars in 1134 bytes} [Tue May 3 12:05:33 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:05:34.218251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 166/328] 10.222.0.21 () {58 vars in 1334 bytes} [Tue May 3 12:05:34 2022] PUT /identity/v3/system/users/23de1799348347aeb1f9215c1528c486/roles/99fd595923034fffbfed50789bff3d54 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:05:34.476379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b31e-00fc-4130-bf2c-8b6ac98b677a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.476379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b31e-00fc-4130-bf2c-8b6ac98b677a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.476379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b31e-00fc-4130-bf2c-8b6ac98b677a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.478017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 163/329] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:34.484717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.485165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.485256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.503806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:34.505006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:34.573537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 167/330] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:34.599649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b31e-00fc-4130-bf2c-8b6ac98b677a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:34.708445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b31e-00fc-4130-bf2c-8b6ac98b677a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:34.743883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:34.744635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.744915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.745184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.762370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:34.770358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:34.771320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:34.772168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 164/331] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:34.777937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:34.878586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e1d7-b437-4e23-b771-2c5aa8c1d743 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:34.913594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:34.914259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:34.914535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:34.914805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:34.915545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:34.915843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:34.917225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:34.930427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 168/332] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:34.936051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:35.040282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd7ea4-56ad-45a0-b2b2-7c16fba7848b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:35.073586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:35.074462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:35.074739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:35.075009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] PATH_INFO: `/v3/users/66db88115c2246b29453ecbbc737addc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:35.076251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] RBAC: Authorizing `identity:get_user(user_id=66db88115c2246b29453ecbbc737addc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:35.078253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fdf1-055e-458f-a48e-2a2923d8d5ec None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:35.080045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 165/333] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:34 2022] GET /identity/v3/users/66db88115c2246b29453ecbbc737addc => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:35.085720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:35.188479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10454f10-7da6-4850-9620-fd2f6cffa491 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:35.227570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:35.228282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:35.228584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:35.228901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:35.229729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] RBAC: Adding query filter params (role.id=31051132b0f6448abb7a60bb660c8c14, user.id=66db88115c2246b29453ecbbc737addc, scope.system=all) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:35.230036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:35.231455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7116d2-4a54-471f-bdb0-05d3dfc987ee None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:35.243716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 169/334] 10.222.0.21 () {56 vars in 1308 bytes} [Tue May 3 12:05:35 2022] GET /identity/v3/role_assignments?user.id=66db88115c2246b29453ecbbc737addc&scope.system=all&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:36.968853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519fac-fc99-4b13-82b4-504e8f4b1f81 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:36.969379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519fac-fc99-4b13-82b4-504e8f4b1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:36.969379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519fac-fc99-4b13-82b4-504e8f4b1f81 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:36.970973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 166/335] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:36.976335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2b07-4253-473f-a950-cb72b6c434e3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:36.976772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2b07-4253-473f-a950-cb72b6c434e3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:36.976960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2b07-4253-473f-a950-cb72b6c434e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:36.995956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ea4f2b07-4253-473f-a950-cb72b6c434e3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:36.997186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ea4f2b07-4253-473f-a950-cb72b6c434e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:37.068863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 170/336] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:37.092430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519fac-fc99-4b13-82b4-504e8f4b1f81 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.112212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802663-26b8-4bb7-a243-9ca8a2b80cd8 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.112549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802663-26b8-4bb7-a243-9ca8a2b80cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.112790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802663-26b8-4bb7-a243-9ca8a2b80cd8 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.114300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 171/337] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:37.119363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.119640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.119910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.139110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:37.141097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:37.225375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 172/338] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:37.265359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519fac-fc99-4b13-82b4-504e8f4b1f81 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.266415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.325484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.328721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.328721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.328721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.337562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-78876a37-03f7-409a-861e-0bd95dee3e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:37.345990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:37.346868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:37.347641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:37.350228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 167/339] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:37.351640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2ba1-7442-49a4-9f27-bd93e9a8f2a3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.352121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2ba1-7442-49a4-9f27-bd93e9a8f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.352591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b2ba1-7442-49a4-9f27-bd93e9a8f2a3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.354194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 168/340] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:37.359518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b2ba1-7442-49a4-9f27-bd93e9a8f2a3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.388354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e4635-31af-44dd-85b9-7f08164dbcb9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.425061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.426149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.426629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.427332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.440770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-eeba8be1-d268-466c-be56-8cecea09fe33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:37.451579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:37.452576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 12:05:37.453362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:37.460522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 173/341] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:37.461824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.462104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.462371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.484428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:37.485935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:37.487530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b2ba1-7442-49a4-9f27-bd93e9a8f2a3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.527658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.528812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.529315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.530317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.531285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:37.531805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:37.533422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:37.543156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 169/342] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:37.544420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.576387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 174/343] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:37.576387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.664778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe438-4748-4ada-85d1-3e6e89c30d38 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.668426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3454a2-e0c2-4494-8d3f-c2b2294b6779 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.702213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.702416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.702858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.703134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.703404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.703997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.704504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.705073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.706017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:37.706518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:37.708146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:37.723622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 170/344] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:37.724896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.771322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:37.772774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:37.828848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41f74-ebf8-4225-af4c-ca06f1557835 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:37.864142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:37.865421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:37.865950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:37.866418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:37.872072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 175/345] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:37.877155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.882541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:37.891575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:37.892519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:37.893334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 171/346] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:37.893996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:37.990658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc5d99-474d-4d43-8725-757434ce0784 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.001711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bcb38-5b20-432c-9cd7-f38f52bda99d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.028613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.030719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.031337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.032101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] PATH_INFO: `/v3/users/23de1799348347aeb1f9215c1528c486` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.034028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] RBAC: Authorizing `identity:get_user(user_id=23de1799348347aeb1f9215c1528c486)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.035779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.037688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 176/347] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/users/23de1799348347aeb1f9215c1528c486 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.038767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.039872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.040790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.041125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.041411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.046267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.047807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.049581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 172/348] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:37 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.051779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.163054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ab60-0cd6-4d94-950e-03b22396dc4d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.164224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2db5-1027-445e-b42c-d7c8b4186827 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.201237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.202481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.202726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.202997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.203749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:38.204052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.205474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.206125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.207179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.207986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.208491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.209511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] RBAC: Adding query filter params (role.id=99fd595923034fffbfed50789bff3d54, user.id=23de1799348347aeb1f9215c1528c486, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:38.210028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.212395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ca0f-4e97-43b3-beb7-d2954cf49faa None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.218999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 177/349] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.218999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.232604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 173/350] 10.222.0.21 () {56 vars in 1308 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/role_assignments?user.id=23de1799348347aeb1f9215c1528c486&scope.system=all&role.id=99fd595923034fffbfed50789bff3d54 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.234833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398b86-73fe-4809-8fd9-977e0dbdad7a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.235123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398b86-73fe-4809-8fd9-977e0dbdad7a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.235405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398b86-73fe-4809-8fd9-977e0dbdad7a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.236788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 174/351] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:38.237559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398b86-73fe-4809-8fd9-977e0dbdad7a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.324130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b57ac-de9f-4709-afed-c13fc41a952d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.361382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.362244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.362521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.362792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.370230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.371881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0e6c1-7873-4b77-a6d7-2a3e6aeb453f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.375773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 178/352] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.381721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.382003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.382279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.402872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:38.404102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:38.429119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398b86-73fe-4809-8fd9-977e0dbdad7a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.484529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 179/353] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:38.485644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.525132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.525891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.526188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.526463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.596633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48eab3-230b-48ce-8ec9-908812204d26 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.636139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.636829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.637107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.637526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.638558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=f93de6293d4a4d309937cb9036619ca6) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:38.639067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.641822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.648987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 180/354] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:38.649859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.657718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:38.659230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:38.790411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 175/355] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:38.796956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb01c8-9274-4721-91ad-a33618cd0f48 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:38.797200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.873006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:38.874325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:38.874601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:38.874870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:38.900565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:38.908518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:38.909501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:38.911088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 181/356] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:38.919776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:38.971523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5256-f095-4a2f-96d6-b468a9877c0c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.013982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.015738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.016234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.016739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.021100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.022921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.025220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 176/357] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:39.031408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.050311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c7219-7293-44d1-b157-2587f80a56e6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.081583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.082251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.082526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.082793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.083539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:39.083830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.085241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9d8db-a53d-4269-a268-043638798df5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.094495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 182/358] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:39.095864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983b3-beea-4bb4-b3c8-0c8bff4af9f8 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.096150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983b3-beea-4bb4-b3c8-0c8bff4af9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.096440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983b3-beea-4bb4-b3c8-0c8bff4af9f8 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.097913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 183/359] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:39.099381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af983b3-beea-4bb4-b3c8-0c8bff4af9f8 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.145964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d8559-7e52-411e-a75d-929bb1f95c6c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.182629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.183824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.184305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.184800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.186220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.187858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d299a06-2002-47cc-bcb9-def4a1836d80 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.190025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 177/360] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:39.191372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.191852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.192314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.215778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:39.217868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:39.218424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af983b3-beea-4bb4-b3c8-0c8bff4af9f8 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.263931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.264394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.264708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.264981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.293914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 178/361] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:39.298279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.366004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.367571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.439676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55915cb3-8a59-479b-a6cb-8ef33252e52c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.473227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 184/362] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:39.474107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.484567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.485512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.485982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.486858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.487885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=f93de6293d4a4d309937cb9036619ca6) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:39.488784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.491025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.498375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 179/363] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=d718902dd4844e5cade3e242453c139a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:39.499880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.596165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a6d6f-ebb4-49e1-aadd-f31da00eb006 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.628355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1554c9-755a-47f9-8fe1-a475aea31c24 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.648381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.650793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.651100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.651415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.664100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:39.673880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:39.674875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:39.675676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 185/364] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:39.682630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.683517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.684696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.685200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.685983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.689531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.691374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.694142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 180/365] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:39.699762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.822435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9157b5-d803-4205-b77c-3adc8c18ac10 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.844032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02c30-65cc-4bb0-b73b-408fb71d287d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:39.861466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.862513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.863007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.863491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.864529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:39.865053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.866626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec59b1-ba8a-4489-8e5f-6d5b171a8562 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.878936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 186/366] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:39.879558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca97ba-4479-4378-bc8a-daf29de2618d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.879847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca97ba-4479-4378-bc8a-daf29de2618d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.880123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca97ba-4479-4378-bc8a-daf29de2618d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.881631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 187/367] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:39.886172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:39.886650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.886937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.887049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:39.887211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.887303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:39.887573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:39.888838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:39.890872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:39.894099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 181/368] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:39.895454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.917433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:39.918699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:39.994012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 188/369] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:39.994790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:39.999999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570d2d-e14e-4eff-a72a-7c31ba417d67 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.038041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.038679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.038963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.039234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.100008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcba09c-6344-4a45-a11f-8878b15cfe62 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.131614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.133115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.136599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.137251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.137529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.137798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.138625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=69291da9311f431cae0071241282637e) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:40.138930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.140998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.147222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 189/370] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=69291da9311f431cae0071241282637e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:40.148042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.263875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 182/371] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:40.264936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb78-5f95-4d13-9ff0-70c42d9e959d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.269449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.308568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.309859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.310142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.310418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.330734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:40.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:40.340962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:40.341749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:40.342422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 190/372] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:40.350342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.410072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215152-701c-4e2f-9d0b-959956113c41 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.457852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.458987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.459863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.460298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.461904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.464387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.467305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 183/373] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:40.472349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.472779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504066-5a72-4914-9cef-75a09c0c0f02 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.512314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.513395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.513740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.514355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.515146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:40.515581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.518295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.532388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 191/374] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:40.536781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.599424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234944-14a1-458a-966a-ec8e1d855b24 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.640386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.641331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.641793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.642216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.643533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.644417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b93-dda3-4320-9fba-24ac93cf946f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.645130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.647038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 184/375] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:40.652613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:40.683206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.683878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.684157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.684460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.815895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7d07-0b33-4a46-b612-a925770b0058 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:40.825999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.828339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.861763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:40.862422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:40.862702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:40.862975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:40.863801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=69291da9311f431cae0071241282637e) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:40.864109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:40.865623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:40.875433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 185/376] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=69291da9311f431cae0071241282637e&role.id=d718902dd4844e5cade3e242453c139a => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:41.003734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 192/377] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:41.009085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:41.135037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3242be-d3af-429a-82aa-c5374cbf2bc1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:41.173331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:41.174585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:41.175058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:41.175520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] PATH_INFO: `/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:41.177306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] RBAC: Authorizing `identity:get_project(project_id=c04ced0b5ee84470a3d6e754eca1d8a4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:41.179015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:41.181433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 186/378] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:41 2022] GET /identity/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:41.187420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:41.328166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e641eb-dabf-444e-86a7-281852a22151 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:41.373947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:41.374832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:41.375108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:41.375439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] PATH_INFO: `/v3/groups/f75a8e99faa7463eb49530570a8e334d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:41.381325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] RBAC: Authorizing `identity:get_group(group_id=f75a8e99faa7463eb49530570a8e334d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:41.382797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c545d-b224-45fd-b84d-e1529eeb111e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:41.388868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 193/379] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:41 2022] GET /identity/v3/groups/f75a8e99faa7463eb49530570a8e334d => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:41.393486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:41.502635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13fb8b-967f-41c4-b89b-c9f87d27ddfd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:41.545011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:41.546213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:41.546491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:41.546763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:41.547586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] RBAC: Adding query filter params (group.id=f75a8e99faa7463eb49530570a8e334d, role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=c04ced0b5ee84470a3d6e754eca1d8a4) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:41.547895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:41.549355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7e5bb-6a08-4168-aa08-d6df36c8a225 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:41.557569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 187/380] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:41 2022] GET /identity/v3/role_assignments?group.id=f75a8e99faa7463eb49530570a8e334d&scope.project.id=c04ced0b5ee84470a3d6e754eca1d8a4&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:41.776671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d82c-96c0-43cd-bd20-968fc1544968 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:41.777007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d82c-96c0-43cd-bd20-968fc1544968 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:41.777128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d82c-96c0-43cd-bd20-968fc1544968 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:41.778508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 194/381] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:41.794906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:41.795245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:41.795507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:41.817472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:41.818678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:41.902029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 188/382] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:41.937158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65d82c-96c0-43cd-bd20-968fc1544968 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.060428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65d82c-96c0-43cd-bd20-968fc1544968 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.100560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.101370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.101648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.101922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.112810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:42.120597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:42.121444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:42.122214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 195/383] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:42.128232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.236614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae8c3c-d6d7-4ec4-b44f-070be88fe281 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.275793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.276858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.277340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.277809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.278774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:42.279408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:42.281050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:42.290389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 189/384] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:42.295662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.426469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093bc4-03ae-437d-85f1-77453f30fae1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.472177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.473074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.473353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.473624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.474827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:42.476275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be94eb-127e-4a06-b50b-d274f92fc9ce None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:42.478225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 196/385] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:42 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:42.484011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.586760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716cb7-8439-4215-a237-972b93d23857 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.627199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.628005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.628288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.628588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.629808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:42.631311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:42.633345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 190/386] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:42 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:42.638992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbdf9-c40e-48e8-a170-72138173bdca None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.639281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbdf9-c40e-48e8-a170-72138173bdca None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.639562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbdf9-c40e-48e8-a170-72138173bdca None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.640950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 197/387] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:42.641840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.647563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.647851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.648129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.689135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:42.690325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:42.754144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289600f6-00b1-48d3-8711-8baad7c1c388 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.797741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.798632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.800172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.800172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/groups/269f14a229de4b768e70c318d330ab28/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:42.807440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, group_id=269f14a229de4b768e70c318d330ab28, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:42.809092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:42.821970 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 198/388] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:42.846003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:42.888579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 191/389] 10.222.0.21 () {58 vars in 1442 bytes} [Tue May 3 12:05:42 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/groups/269f14a229de4b768e70c318d330ab28/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:42.959082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9f0aa-19ef-4b5f-90c5-709dc5c1ba73 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:42.996401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:42.997250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:42.997534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:42.997812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.009786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:43.020075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:43.021083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:43.021875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 199/390] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:43.029058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.153361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354574-870b-443a-a30a-a68fa4df62f8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.192124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.192842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.193124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.193398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.194163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:43.194472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:43.195873 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:43.206455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 192/391] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:43.211416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.313226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789facb5-1731-4bc9-9da6-0cb7af6a2725 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.351429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.351429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.351429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.351429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.351768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:43.352664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eb3e1-f827-4f3e-8e8e-525e07f1d33c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:43.354294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 200/392] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:43.360259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.370091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fb87-8531-436c-9b4b-880b9c715ac1 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.370384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fb87-8531-436c-9b4b-880b9c715ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.370643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fb87-8531-436c-9b4b-880b9c715ac1 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.372175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 201/393] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:43.378180 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.378460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.378730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.400237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:43.402387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:43.473876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1a38-9b49-4c26-9b8c-e845324a29dd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.484467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 202/394] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:43.499850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.507854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.508877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.509220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.509561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.511572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:43.512475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:43.519701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 193/395] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:43.521149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.614869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5bd2c-4c0c-4a8d-8b69-9fe98fe017cf None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.625121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43002e-e62d-4e9d-a8b1-11190484558f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.651474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.652665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.653184 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.653668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.658677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.659570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.659845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.660124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6/groups/269f14a229de4b768e70c318d330ab28/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.662402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93de6293d4a4d309937cb9036619ca6, group_id=269f14a229de4b768e70c318d330ab28, role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:43.663997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:43.666911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:43.675250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:43.676127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:43.677208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:43.679429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 203/396] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:43.685379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:43.739353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 194/397] 10.222.0.21 () {58 vars in 1442 bytes} [Tue May 3 12:05:43 2022] PUT /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6/groups/269f14a229de4b768e70c318d330ab28/roles/d718902dd4844e5cade3e242453c139a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:05:43.789822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa152fa-7422-435d-9a7a-649036eb09e4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:43.827830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:43.828946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:43.829412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:43.829860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:43.830816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:43.831297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:43.832888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:43.846833 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 204/398] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:43.848591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.046331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d588e-5502-4707-bae1-11c5c31de048 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.083609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.084561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.084841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.085109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.087284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:44.088750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4c5e5-e597-41b8-a55a-d3521d833fbf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:44.090670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 195/399] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:43 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:44.097386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.212940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfbb1-f7ea-454e-b270-a4709b4e50e6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.216892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ebb5-b9c1-4f5b-b7e0-d22f7449f3ad None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.217276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ebb5-b9c1-4f5b-b7e0-d22f7449f3ad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.217634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ebb5-b9c1-4f5b-b7e0-d22f7449f3ad None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.222364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 196/400] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:44.225839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.226416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.226913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.246501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:44.248133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:44.253059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.253697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.253982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.254254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.255448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:44.256992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:44.263533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 205/401] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:44.264822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.328847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 197/402] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:44.369025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.374250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c2c76-d8e6-4330-b398-5d065523279e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.408174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.409113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.409398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.409682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/groups/269f14a229de4b768e70c318d330ab28/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.411664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, group_id=269f14a229de4b768e70c318d330ab28, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:44.413139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76d26-47c7-4c33-b11d-53a6c09e0c13 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:44.499518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e541-7f47-45a4-94ed-2996d3d8ad9f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.527357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 206/403] 10.222.0.21 () {58 vars in 1442 bytes} [Tue May 3 12:05:44 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/groups/269f14a229de4b768e70c318d330ab28/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:44.539358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.540922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.540922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.541431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.557307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:44.561031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab75-db00-441d-87a7-13f0fcc11f88 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.561367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab75-db00-441d-87a7-13f0fcc11f88 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.561654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab75-db00-441d-87a7-13f0fcc11f88 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.564333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 207/404] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:44.567271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:44.568190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:44.571395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:44.572002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.572002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.572002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.574287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 198/405] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:44.580694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.599834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:44.601101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:44.691851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f4f0-d34d-4d7a-ae5c-bbfd8b45fa50 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.727721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.729162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.729886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.730568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.731942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:44.733224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:44.735616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:44.738981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 208/406] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:44.750120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 199/407] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:44.759375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.797994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.878373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c576b-27c5-4235-9e96-721742c11b66 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.915844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b226450-f671-4248-9753-fd9035475686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.916731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b226450-f671-4248-9753-fd9035475686 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.917010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b226450-f671-4248-9753-fd9035475686 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.917283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b226450-f671-4248-9753-fd9035475686 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.921068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b226450-f671-4248-9753-fd9035475686 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:44.922510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b226450-f671-4248-9753-fd9035475686 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:44.922897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8467-88df-46e4-8e82-df101c4f88cb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:44.924486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 209/408] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:44.930232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b226450-f671-4248-9753-fd9035475686 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:44.960187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:44.961014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:44.961302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:44.961564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:44.971970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:44.980507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:44.981581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:44.982480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 200/409] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:44.989324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:45.046019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b226450-f671-4248-9753-fd9035475686 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.087815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.089119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.089653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.090127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.091698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.093914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.096147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 210/410] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:45.102133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:45.129160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64af9-0c1b-4bee-aab4-c3cf62b6c379 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.182859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.183530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.183811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.184081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.184849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:45.185150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.186992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.197930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 201/411] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:45.205392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:45.215712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf8cd-27df-4651-b3ef-5599ded59373 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.277337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.278653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.279149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.280173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e/groups/269f14a229de4b768e70c318d330ab28/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.282982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=69291da9311f431cae0071241282637e, group_id=269f14a229de4b768e70c318d330ab28, role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.284813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.362601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb244b-8545-4a3f-a96c-ebfdc1cc38d8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.392095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 211/412] 10.222.0.21 () {58 vars in 1442 bytes} [Tue May 3 12:05:45 2022] PUT /identity/v3/projects/69291da9311f431cae0071241282637e/groups/269f14a229de4b768e70c318d330ab28/roles/d718902dd4844e5cade3e242453c139a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:45.401262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.402134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.402410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.402676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] PATH_INFO: `/v3/groups/f75a8e99faa7463eb49530570a8e334d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.404014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] RBAC: Authorizing `identity:get_group(group_id=f75a8e99faa7463eb49530570a8e334d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.406225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.408223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 202/413] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:45 2022] GET /identity/v3/groups/f75a8e99faa7463eb49530570a8e334d => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:45.413742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:45.560488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f3d56-d6fe-4c6a-a96b-dd2c1b4e9bb1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.601026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.602311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.602805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.603299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] PATH_INFO: `/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.609271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] RBAC: Authorizing `identity:get_project(project_id=c04ced0b5ee84470a3d6e754eca1d8a4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.611073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4349d4-c656-49d1-a219-5279f4014a63 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.613481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 212/414] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:45 2022] GET /identity/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:45.618945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:45.740988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0356c74-6c36-4d78-8246-7280eca20963 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:45.776240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:45.777141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:45.777421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:45.777695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] PATH_INFO: `/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4/groups/f75a8e99faa7463eb49530570a8e334d/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:45.780263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04ced0b5ee84470a3d6e754eca1d8a4, group_id=f75a8e99faa7463eb49530570a8e334d, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:45.781731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4e34-119e-468f-b464-55e3ecdbb866 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:45.863023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 203/415] 10.222.0.21 () {58 vars in 1442 bytes} [Tue May 3 12:05:45 2022] PUT /identity/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4/groups/f75a8e99faa7463eb49530570a8e334d/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:05:46.288385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cf475-4bf9-423c-8d7e-b36dd3618d61 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.289040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cf475-4bf9-423c-8d7e-b36dd3618d61 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.289568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cf475-4bf9-423c-8d7e-b36dd3618d61 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.291135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 213/416] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:46.297518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.298048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.298526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.317128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:46.318612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:46.392203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 204/417] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:46.415586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cf475-4bf9-423c-8d7e-b36dd3618d61 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:46.537272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cf475-4bf9-423c-8d7e-b36dd3618d61 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:46.580234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:46.581066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.581344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.581616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.597189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:46.604913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:46.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:46.606547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 214/418] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:46.612522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:46.765498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370eee-fc86-4351-b20b-b618cc96709b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:46.800120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:46.800826 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.801107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.801379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.802380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:46.802683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:46.804052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89741880-9b0b-4c54-b393-ca175eb3bda4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:46.812796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 205/419] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:46.818257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:46.867546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f14c-57de-4092-8e29-ace764fe3d74 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.867821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f14c-57de-4092-8e29-ace764fe3d74 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.868015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f14c-57de-4092-8e29-ace764fe3d74 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.869646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 206/420] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:46.874589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:46.874870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:46.875139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:46.891980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:46.893170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:46.960303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 207/421] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:46.983715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:46.987921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465a70-86ae-4eed-981b-c50b8555b71f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.069967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.070624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.070967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.071259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.082982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453431-20cb-4d46-bb6b-561d46f8d97b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.116933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.117793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.118012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.118279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.128441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:47.136727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:47.139272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:47.141180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 208/422] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:47.148461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.241186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.242993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.319147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e103-7224-4447-90ea-7ba921814f09 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.360869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 215/423] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:47.366429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.396943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.398011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.398307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.398582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.399596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:47.399899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.402012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f598aa-6711-401a-b346-adb4e1568f48 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.411891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 209/424] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:47.418617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435642-8453-4ddd-9850-77d766cc20d7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.418903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435642-8453-4ddd-9850-77d766cc20d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.419177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435642-8453-4ddd-9850-77d766cc20d7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.420508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 210/425] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:47.424631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435642-8453-4ddd-9850-77d766cc20d7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.485755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63512-dbed-4cbb-8875-750d2831e5a2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.526109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.526986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.527261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.527530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.529476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.531515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144aa8-2e6a-4587-88b2-8a95c982402e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.534473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 216/426] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:47.535937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.536220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.536529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.540287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435642-8453-4ddd-9850-77d766cc20d7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.561794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:47.563389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:47.578809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.579587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.580130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.580552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.644496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 217/427] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:47.645560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.674778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.676632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.774775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cc5e0-fef3-4813-9a6f-783b42389a55 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.790689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 211/428] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:47.792555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.815495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.816608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.817072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.817524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.819502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.821253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.823037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 218/429] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:47.829635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.908829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316905a0-2f69-422e-b2d9-3d6d78a58313 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.928544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c51e-4f96-410b-bfa4-60ad19b8ac49 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:47.944448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.945536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.946026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.946494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.956968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:47.962133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:47.963167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:47.963591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:47.964005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] PATH_INFO: `/v3/projects/f93de6293d4a4d309937cb9036619ca6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:47.965376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] RBAC: Authorizing `identity:get_project(project_id=f93de6293d4a4d309937cb9036619ca6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:47.966482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:47.967578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 12:05:47.968470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:47.969864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:47.971801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 219/430] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/projects/f93de6293d4a4d309937cb9036619ca6 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:47.972742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:47.973854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 212/431] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:47.974771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.080769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154460d-9360-4c1c-a3c9-d7b1f2babca7 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.099754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65399b-b12b-426f-b26c-76fe89eda26d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.129028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.129850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.130386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.130758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.132309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=f93de6293d4a4d309937cb9036619ca6) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:48.132741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.134253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.136296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.137141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.137645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.138139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.139129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:48.139637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.140439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 220/432] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:48.141229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.141782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.151106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 213/433] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:05:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:48.158279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.297575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30d71-b7f7-42b2-8496-61621a0096ac None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.318353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6de5-aa53-4364-9481-0933bf79f163 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.333363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.334249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.334524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.334794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.336052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.337569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933cce-3a33-4a87-9d2f-18bd53222d58 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.344669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 221/434] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:48.346202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ee22-b463-49a1-958d-8aeffdbe727b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.346518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ee22-b463-49a1-958d-8aeffdbe727b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.346789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ee22-b463-49a1-958d-8aeffdbe727b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.348457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 222/435] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:48.352357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1ee22-b463-49a1-958d-8aeffdbe727b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.356733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.357470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.358259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.358637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.438664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.440446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.467709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1ee22-b463-49a1-958d-8aeffdbe727b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.509070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.509689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.509926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.510201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.511032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=f93de6293d4a4d309937cb9036619ca6) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:48.511351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.512785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e7493-1944-4451-8d96-1d6d8e1ee7a5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.521223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 223/436] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=f93de6293d4a4d309937cb9036619ca6&role.id=d718902dd4844e5cade3e242453c139a => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:48.523243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.523420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.523698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.541818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:48.542914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:48.564446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 214/437] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:48.569882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.615938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 224/438] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:48.640614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.694983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fb30-6ec3-4dc5-a1a7-38015a4d8487 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.734218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.735121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.735401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.735669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.736982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.738425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.740464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 215/439] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:48.746723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.776271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c10d82-2084-4440-b8ca-28ff8e9c7f36 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.821766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.822917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.823396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.823885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.835531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:48.844121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:48.845068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:48.845870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:48.847875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 225/440] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:48.854153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.890113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7780a6-d5e6-4ea1-b34b-b79865712259 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.927333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.928418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.928546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.928804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.930629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:48.931399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac0d51-54a4-4f4c-bea1-73ded6461f00 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:48.933041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 216/441] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:48.934329 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1bbb-7e8f-45a3-b81f-432861f646e6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.934488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1bbb-7e8f-45a3-b81f-432861f646e6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.934752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1bbb-7e8f-45a3-b81f-432861f646e6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:48.936560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 217/442] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:48.941419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b1bbb-7e8f-45a3-b81f-432861f646e6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:48.962229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce4a9-5296-40ba-844a-56b3a8890e83 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:48.998739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:48.999431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:48.999715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:48.999987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.000766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:49.001071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.002428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed4503-2f13-4e56-a252-8f5c632b6ba4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.010496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 226/443] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.011711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.011994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.012270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.034336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:49.036003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:49.049793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b1bbb-7e8f-45a3-b81f-432861f646e6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.082640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.083228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.083508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.083779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.084621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=31051132b0f6448abb7a60bb660c8c14, scope.project.id=69291da9311f431cae0071241282637e) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:49.084929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.086343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.091989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 218/444] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:48 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=69291da9311f431cae0071241282637e&role.id=31051132b0f6448abb7a60bb660c8c14 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.092793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.112395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 227/445] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:49.123791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.200891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef10ef-b8d1-4f35-a60d-fbb4c3adfec4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.230924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398cc35-929e-47ba-adf8-6c3c5116613d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.235895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.236595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.236878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.237153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.266714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.267821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.268287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.268589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.280971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:49.288876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:49.289825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:49.290616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 228/446] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:49.296552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.305931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.307727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.413114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64716c-cc25-4047-bae3-8cc484dc00df None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.418873 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 219/447] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:49.425836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.449212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.449939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.450220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.450538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.451318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:49.451847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.453042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.461173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 229/448] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.467238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.528441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065093a5-ea34-4d3f-8882-dc8962b286c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.560765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.561618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.561891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.562159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] PATH_INFO: `/v3/projects/69291da9311f431cae0071241282637e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.563316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] RBAC: Authorizing `identity:get_project(project_id=69291da9311f431cae0071241282637e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.564796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.566472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 220/449] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/projects/69291da9311f431cae0071241282637e => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.568026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a6fe-f0c0-463f-b201-78d54e02bee0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.571828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.601381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.601949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.602227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.602494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.662701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc62-4162-403c-9e19-f64f231ac074 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.664115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.665576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.694604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.695440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.695985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.695985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] PATH_INFO: `/v3/groups/269f14a229de4b768e70c318d330ab28` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.697154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] RBAC: Authorizing `identity:get_group(group_id=269f14a229de4b768e70c318d330ab28)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.698576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.700169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 221/450] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/groups/269f14a229de4b768e70c318d330ab28 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.705866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.755468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 230/451] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:49.760938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.797001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffae3-b92d-4e05-b7ef-2ab7991757cb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.828879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.829516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.829793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.830072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.830886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] RBAC: Adding query filter params (group.id=269f14a229de4b768e70c318d330ab28, role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=69291da9311f431cae0071241282637e) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:49.831193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.832654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.838595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 222/452] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/role_assignments?group.id=269f14a229de4b768e70c318d330ab28&scope.project.id=69291da9311f431cae0071241282637e&role.id=d718902dd4844e5cade3e242453c139a => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.853502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d0e96-1269-4d38-a51d-20df7caf2c7e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:49.888010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:49.889446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:49.889722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:49.889989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] PATH_INFO: `/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:49.891192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c04ced0b5ee84470a3d6e754eca1d8a4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:49.892657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:49.894351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 231/453] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/projects/c04ced0b5ee84470a3d6e754eca1d8a4 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:49.900042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:49.998696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78abfa-995d-4d01-8872-ba7888ff38c6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:50.033297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:50.034156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:50.034436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:50.034714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] PATH_INFO: `/v3/groups/f75a8e99faa7463eb49530570a8e334d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:50.035905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] RBAC: Authorizing `identity:get_group(group_id=f75a8e99faa7463eb49530570a8e334d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:50.037445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76595004-2ac5-42c0-9a4b-b5176469034f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:50.039068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 223/454] 10.222.0.21 () {56 vars in 1180 bytes} [Tue May 3 12:05:49 2022] GET /identity/v3/groups/f75a8e99faa7463eb49530570a8e334d => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:50.045203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:50.142593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9a3b-9d85-4269-a7f5-b0ecd68124f2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:50.176230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da782872-a516-4912-8794-834355d28d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:50.177182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782872-a516-4912-8794-834355d28d1b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:50.177464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782872-a516-4912-8794-834355d28d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:50.177740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da782872-a516-4912-8794-834355d28d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:50.178572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da782872-a516-4912-8794-834355d28d1b None admin] RBAC: Adding query filter params (group.id=f75a8e99faa7463eb49530570a8e334d, role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=c04ced0b5ee84470a3d6e754eca1d8a4) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:50.178879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da782872-a516-4912-8794-834355d28d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:50.180323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da782872-a516-4912-8794-834355d28d1b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:50.186137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 232/455] 10.222.0.21 () {56 vars in 1376 bytes} [Tue May 3 12:05:50 2022] GET /identity/v3/role_assignments?group.id=f75a8e99faa7463eb49530570a8e334d&scope.project.id=c04ced0b5ee84470a3d6e754eca1d8a4&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:52.881163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de250d-5d72-44c1-93e6-ea04ee2107de None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:52.881689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de250d-5d72-44c1-93e6-ea04ee2107de None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:52.881689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de250d-5d72-44c1-93e6-ea04ee2107de None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:52.883265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 224/456] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:52.889083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d5d5-7611-4902-87e4-632d4aae71a7 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:52.889570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d5d5-7611-4902-87e4-632d4aae71a7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:52.889648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d5d5-7611-4902-87e4-632d4aae71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:52.917263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2823d5d5-7611-4902-87e4-632d4aae71a7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:52.918450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2823d5d5-7611-4902-87e4-632d4aae71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:53.014652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 233/457] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:53.048129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de250d-5d72-44c1-93e6-ea04ee2107de None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.159904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7123dd-f99c-46f1-89dd-5d2a5e2d5cea None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.160193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7123dd-f99c-46f1-89dd-5d2a5e2d5cea None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.160388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7123dd-f99c-46f1-89dd-5d2a5e2d5cea None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.161755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 234/458] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:05:53.166496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.167025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.167496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.178205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de250d-5d72-44c1-93e6-ea04ee2107de None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.209336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:53.210870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:53.223058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.224172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.224673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.225148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.239539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.241325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:53.273085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:53.274009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:53.274831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:53.274831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:53.274831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:53.274831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:53.285827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 225/459] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:53.291978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.342833 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 235/460] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:53.373835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.432640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5b60-b094-4c4b-b03c-0fee1c14dc04 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.477717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.478754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.479260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.479741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.480714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:53.481219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.482886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.518585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 226/461] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:53.524383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.535469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d8c3d-d555-4e9c-9b25-0d3ad20b3685 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.575927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.577407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.577693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.577961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.588081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.589580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-4aeb2254-65da-4bcd-b8e2-2d57c5e6b756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:53.606990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:53.607901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:53.608746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:53.608746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:53.608746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:53.608746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:53.608746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 236/462] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:53.612385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9988c-809d-44bd-86bd-1d6194fad64c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.612385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9988c-809d-44bd-86bd-1d6194fad64c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.612385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9988c-809d-44bd-86bd-1d6194fad64c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.615899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 237/463] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:53.616738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9988c-809d-44bd-86bd-1d6194fad64c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.628392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495710b-f2c9-42cf-9cea-0fa237fc2478 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.663155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.663823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.664105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.664399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.665133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.666572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c812d6-9a5f-4cfb-a58d-ad782918c7f6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.717171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9988c-809d-44bd-86bd-1d6194fad64c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.748587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 227/464] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:53 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:53.750274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c67b-6d34-4fdd-89c7-f6c67b3eb11c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.750583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c67b-6d34-4fdd-89c7-f6c67b3eb11c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.750862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c67b-6d34-4fdd-89c7-f6c67b3eb11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.758466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.759391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.759844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.760294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.761076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:53.761381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.762839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a3eec-0b07-4988-8b5c-246d40e33839 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.773940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0e24c67b-6d34-4fdd-89c7-f6c67b3eb11c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:53.775514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0e24c67b-6d34-4fdd-89c7-f6c67b3eb11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:53.775625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 238/465] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:53.777158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926bbb-81d7-4ff7-b591-65cac6399f9b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.777446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926bbb-81d7-4ff7-b591-65cac6399f9b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.777729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926bbb-81d7-4ff7-b591-65cac6399f9b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.783529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 239/466] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:53.785406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926bbb-81d7-4ff7-b591-65cac6399f9b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:53.853266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 228/467] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:53.861901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.862233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.862468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.896565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:53.897806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:53.914685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926bbb-81d7-4ff7-b591-65cac6399f9b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:53.969424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:53.970027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:53.970334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:53.970611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:53.971329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:53.973233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:53.976543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 229/468] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:53.977467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.058347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 240/469] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:53 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:54.059359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.100861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25416bf-7da4-4439-bbdb-816d0c760a5c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.155914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.157363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.158245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.158743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.170481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61cb44-6cd7-4710-beb7-2cd41b1a09c0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.175096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.177240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:54.203497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:54.204491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:54.205344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:54.205344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:54.205344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:54.205344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.206318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 230/470] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:54.211453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.211453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.211453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.211453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.212248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.225242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.226708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:54.245364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:54.246273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:54.247096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:54.247096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:54.247096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:54.247096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:54.251552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 241/471] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:54.252963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.320621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925275c-ebdc-443b-894b-bae93002090a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.356450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353217d-e3b9-4045-9bf0-f73ca0d32519 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.365696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.365696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.365696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.365696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.366050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:54.366050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.366050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7e9eb-43ed-4ab5-b461-97878a3d54fe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.377253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 231/472] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:54.383548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c7f7-37fb-4e8c-a09e-07873cb61a11 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.384087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c7f7-37fb-4e8c-a09e-07873cb61a11 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.384598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c7f7-37fb-4e8c-a09e-07873cb61a11 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.386607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 232/473] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:54.387501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c7f7-37fb-4e8c-a09e-07873cb61a11 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.393421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.394083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.394364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.394701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.395425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:54.395780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.397186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc93cf-84f3-4fb8-8b4f-7382bc0cd06e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.411013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 242/474] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:54.412586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.413949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.414225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.431672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:54.432882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:54.508021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c7f7-37fb-4e8c-a09e-07873cb61a11 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.508189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 243/475] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:54.508915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.546696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.548141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.548664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.549266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.550191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.552242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.629254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4088-39ae-487f-9ded-889279ded23b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.664014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.665068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.665650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.666136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.667026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.668769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 233/476] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:54 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:54.672464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.672606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:54.776062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 244/477] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:54 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:05:54.792867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7274880-f115-40a5-8822-b291fb0271ba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:54.833162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:54.833847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:54.834126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:54.834395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:54.835152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:54.836670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:54.884684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.sql.core [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 12:05:54.884684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 12:05:54.884684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [parameters: {'id': 'c09b2152084e4f37b980615f0f7977d0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 12:05:54.884684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application conn.query(q) May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application result.read() May 03 12:05:54.902019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return ref.to_dict() May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:05:54.903386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application next(self.gen) May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application yield resource May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application next(self.gen) May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self.session.rollback() May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self.force_reraise() May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise self.value May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application session.commit() May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 12:05:54.905609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._prepare_impl() May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self.session.flush() May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._flush(objects) May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application compat.raise_( May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application flush_context.execute() May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rec.execute(self) May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 12:05:54.906488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:05:54.907914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application conn.query(q) May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application result.read() May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:05:54.913723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [parameters: {'id': 'c09b2152084e4f37b980615f0f7977d0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:54.915621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 12:05:54.919266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:54.922301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 234/478] 10.222.0.21 () {60 vars in 1131 bytes} [Tue May 3 12:05:54 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:54.922437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:55.026294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb280c-d4ee-4148-a000-b9e7ed7d3b78 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:55.066114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:55.067290 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:55.067786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:55.068296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:55.078686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-4f689052-af12-4540-ac4d-2ce85da5b294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:55.087288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:55.088183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 12:05:55.089069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:55.089980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 245/479] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:05:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:55.096404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:55.213081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed876-b3dc-42cb-9411-6f923190da1b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:55.247657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:55.248328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:55.248634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:55.248906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:55.249643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:55.249942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:55.251295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b39b4-ab45-4061-a9cb-4c4f9c9450d9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:55.260288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 235/480] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:56.223487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ccbbd-a12d-4e01-ae0f-46fae8d1f3a9 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.224484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ccbbd-a12d-4e01-ae0f-46fae8d1f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.224974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ccbbd-a12d-4e01-ae0f-46fae8d1f3a9 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:56.226876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 246/481] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:56.233757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.234673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.235130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:56.256776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:56.258010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:56.352653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 236/482] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:56.397512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ccbbd-a12d-4e01-ae0f-46fae8d1f3a9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:56.534029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ccbbd-a12d-4e01-ae0f-46fae8d1f3a9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:56.576792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:56.577920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.578380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.578828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:56.596924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:56.605070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:56.605961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:56.606757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:56.609779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 247/483] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:56.615425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:56.732212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a28a6f-6f05-492f-bd64-a56870b4636a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:56.768983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:56.769668 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.769950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.770220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:56.770980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:56.771283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:56.772743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e835d-9677-4c7d-b24e-3af17abca17c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:56.787264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 237/484] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:56.793503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:56.959563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb923-c23e-49cd-90cc-68f0c5e70ec9 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:56.973481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-9b4b-4744-b14b-a9fe88848663 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.973814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-9b4b-4744-b14b-a9fe88848663 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.974028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-9b4b-4744-b14b-a9fe88848663 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:56.975689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 238/485] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:56.980621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:56.980903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:56.981181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.007709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.009067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.009559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.010033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.011156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:57.014802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:57.036499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.038365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:57.059241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:57.060686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:57.061567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:57.061567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:57.061567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:57.061567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:57.064327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 248/486] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:57.069789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.154330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 239/487] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:05:57.189723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.235091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a911c9-cb25-442e-8506-b8d5b7cbd739 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.301298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.302600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.303092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.303578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.304562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:57.305083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.306663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.328099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 249/488] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:57.340294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.353233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3de4c-d5ef-4d22-a8ce-76305a45ac36 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.401701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.402518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.402792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.403062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.428988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:57.437426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:57.438416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:57.439197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 240/489] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:57.445945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.456901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a62ce-b131-4821-bece-5914688745d6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.499523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.500333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.500636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.500905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.511873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.513416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:05:57.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:57.547937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:57.550245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 250/490] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:57.556494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.570676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b824a9b-0153-4c03-ab24-627912b77833 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.613993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.614671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.614947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.615222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.615968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:57.616269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.617700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.635200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 241/491] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:05:57.641346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.656881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b1b9-dd92-474e-9a2b-54160d92a5ec None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.694161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.694825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.695103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.695376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.696207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:57.696538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.697989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.736473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 251/492] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:57.744168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.764592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166320-e5c1-4677-ab77-de9f9985d10e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.805396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.806806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.807029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.807302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.820382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.822224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c69923d4-bca7-4841-ba9c-69c7ded2b74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:57.840757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:57.842884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 242/493] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f52f-541b-4fc0-8113-5a40c9f17c8c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f52f-541b-4fc0-8113-5a40c9f17c8c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.844967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f52f-541b-4fc0-8113-5a40c9f17c8c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.845963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 243/494] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:57.850255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5408b6-abb7-4331-b7d4-957cd810f327 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.850255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5408b6-abb7-4331-b7d4-957cd810f327 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.850255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5408b6-abb7-4331-b7d4-957cd810f327 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.850255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 244/495] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:57.850622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5959-c37e-43b7-a03e-0bfc7a458af8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:57.852546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.852828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.853098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.869837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:57.871005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:57.883628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:57.884274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:57.884584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:57.884863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:57.941846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 245/496] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:57.942637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:57.956773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:57.958915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e8f90-c862-4d2b-9946-a299c4a4aab8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.042863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6252e2-826c-4be8-9c04-ed9cdb0d570a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.058820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 252/497] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:05:58.058820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.058820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.058820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.073431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:58.074613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:58.081136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.081808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.082084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.082351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.083053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:58.083373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.084776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.096584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 246/498] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:58.098147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.145915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 253/499] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:58.146608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.202386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a993-5e62-4fb9-992d-7b8db8520da6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.236647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.237444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.237727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.237997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.247924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:58.255087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185e8df-9578-4fa2-af50-1be732d9ddad None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:58.255958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.257007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:58.257857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:58.262261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 247/500] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.263035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.289056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.289892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.290176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.290446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.300471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.302227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:58.327043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.327951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 254/501] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.328835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.376547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe990-fa70-4a38-a66b-c5d2f0090402 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.408627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.409410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.409686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.409954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.416994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.418414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.421590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cd8b4-d14c-4246-9fd1-d5f048d6467f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:05:58.433649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.434524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:58.435406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 248/502] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.435959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.457328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.458109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.458380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.458646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.468760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-644f746e-f3b2-42d6-b9a1-3cecb1b73fd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:05:58.476323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.477398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:58.478358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 255/503] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.479158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e4f-e853-4943-978b-b4a129cda5a9 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.479158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e4f-e853-4943-978b-b4a129cda5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.479158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72e4f-e853-4943-978b-b4a129cda5a9 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.480535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 256/504] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:05:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:05:58.483049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72e4f-e853-4943-978b-b4a129cda5a9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.533138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040cd16-77ed-42f2-9e3a-dc9f63a3cb0e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.564737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.565395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.565669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.565938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.566673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:58.566972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.568417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.576608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 249/505] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:58.577460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.582496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72e4f-e853-4943-978b-b4a129cda5a9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.612697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.613360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.613637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.613904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.614607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:58.614901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.616250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.627867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 257/506] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:58.628684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.670120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525822-7273-4eae-afd9-fc06a659c388 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.702805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.703464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.703744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.704016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.704872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:58.705182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.706619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903cf45-14fb-43d4-bfc1-fe0b9d6fba1d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.723536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c087-9775-4050-9bcd-29c6dc43729c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.742159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 250/507] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:58.743206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.743569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.743760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.755903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.756590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.756870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.757143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.757879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:58.758179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.759531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.759648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:05:58.760875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:05:58.767772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 258/508] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:58.768577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.823483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 251/509] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:05:58.824306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.860560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e918f7a-b58f-425c-98e2-e6a91ba6ae47 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.896030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.896848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.897132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.897406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.907581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.909051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.920212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef482ab-13e3-4966-9d78-b455015cc8b0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:58.925810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.927057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.927991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:58.927991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:58.927991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:58.927991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:05:58.931888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 259/510] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.932616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:58.952504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:58.953298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:58.953578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:58.953854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:58.960241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:58.961717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:05:58.975754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:58.976619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:58.977449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 252/511] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:58.977922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.025195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba10c-e7f4-44f1-a989-8b31b168178b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.057164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.057803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.058084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.058385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.073442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c692a-443c-4cd5-8ade-909225f3106f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.104291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.105107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.105387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.105658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.116294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.117748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.120993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.122425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:59.134752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:59.135784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 253/512] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:59.136870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.218129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 260/513] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:05:59.218992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.228312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a6d5-24a3-460b-ac25-0f1463edf86c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.259528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.260303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.260636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.260913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.271444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.273001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:59.290170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:59.291005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:59.291842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:59.291842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:59.291842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.291842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:59.291842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 254/514] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:59.292096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.310706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef610f-09f1-4c0a-bf14-468e3b6d5e1c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.343479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.344383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.344666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.344933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.345678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.345931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.347330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.358243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 261/515] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.359025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.420110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f7de-502a-45a9-ae6f-7117b18835ca None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.451749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.452413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.452693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.452964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.453728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.454032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.455458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.471810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 255/516] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.472620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.481004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a581-17f9-4413-bdbf-2659bf017860 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.512029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.512710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.512988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.513303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.514014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.514311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.515671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.526810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 262/517] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.527504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.565954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e22356-637a-4e03-9407-6ec14682f99c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.598357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.599151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.599434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.599709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.609447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.610899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.627629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8476-6a9b-4906-aed8-268c1eadbd88 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:05:59.628516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:59.629537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:59.630412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:05:59.630412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:05:59.630412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:05:59.630412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:59.630412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 256/518] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:59.630679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.662489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.663145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.663430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.663704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.664487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.664747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.666133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.677677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 263/519] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.678394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.724351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd08cc8-8bf0-48b5-a7e7-51826bda0ac6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.756448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.757225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.757503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.757770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.764437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.765870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.769956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7169686-43c0-4a1d-94be-29361b7ab746 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:05:59.780192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:59.781108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:59.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 257/520] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:59.783104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.803796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.804472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.804758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.805042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.805913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.806312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.807625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.813377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 264/521] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.814134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.884875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec666e3-d2ae-4487-ac3e-ac0951ff56b1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.920438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47506ae-9d1f-4289-a6f6-a25473eae321 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:05:59.922175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.923008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.923567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.923891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.934208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.936216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:05:59.951605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:05:59.952657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:05:59.953531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 258/522] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:05:59.954083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:05:59.962719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:05:59.963346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:05:59.963628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:05:59.963901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:05:59.964670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:05:59.964975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:05:59.966811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:05:59.987470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 265/523] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:05:59.987470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.059150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345508f-b7a0-4921-b515-cab8aa46a262 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.094128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e53f8-6055-419d-af0f-ca0b9937de97 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.100039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.100848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.101399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.101399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.102094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.103593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.126578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.134909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.146765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 266/524] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:05:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:00.147570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.204624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 259/525] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:05:59 2022] POST /identity/v3/users => generated 247 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:00.205405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.259045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc963-f56b-496f-a58d-5cdad61d4a28 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.300077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.301101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.301385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.301661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.302923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:00.303087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.304588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.317491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99173-81f6-495d-8f0a-cf195e3a48b2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.324805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 267/526] 10.222.0.21 () {56 vars in 1139 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:00.326514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.355610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.356475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.357356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.357685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.365293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.366777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:00.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:00.383774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:00.385210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 260/527] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:00.385719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.447918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319fd5d-94a1-41c8-b3c4-43bd4ddfa6a4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.486514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.487171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.487454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.487726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.499599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce6c5-a1fc-4e3e-ba90-736056d2b593 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.540700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.541356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.541679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.541960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.571074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.573405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.630980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.632842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.684491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 268/528] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:00.685392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.735846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 261/529] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:00.737151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.784462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c524ee-1c43-43c6-ab5f-015d42ac4167 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.819587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.820243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.820554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.820824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.821700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:00.822057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.823580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.848847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4c69-dd35-4095-ab82-4fd9b30a62e5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.854458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 269/530] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:00.855360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.887826 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.889088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.889639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.890118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:00.901018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:00.902842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:00.922865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:00.923929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:00.924831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:00.924831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:00.924831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:00.924831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:00.926933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 262/531] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:00.927926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:00.964014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dba9a-02b4-461a-bced-1d34f42c80d1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:00.998566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:00.999728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:00.999728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:00.999922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.010988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.012517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:01.031800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:01.032778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:01.033729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:01.033729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:01.033729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:01.033729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:01.033729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 270/532] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:01.033989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.034975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3866a0-764a-4f3a-9540-2f08d73fb038 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.070604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.071616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.072122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.072628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.073691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=e0e3a64bbcfa4449b4aba61a201c1c3b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.074208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.075951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.081890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 263/533] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:00 2022] GET /identity/v3/role_assignments?user.id=e0e3a64bbcfa4449b4aba61a201c1c3b&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:01.082912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.136467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43e84-09e0-473c-92de-e84ea54a68f7 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.172922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.173429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.173709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.173984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.174718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.175021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.176427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.189615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd66cc-76e0-4b71-94b0-3dbd00e9d932 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.190870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 271/534] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:01.202160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.227583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.228682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.229170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.229649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.230609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.231168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.233424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.254650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 264/535] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:01.259931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.322371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3778b3d-0e71-4740-9f75-510ec73e5050 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.357577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.358395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.358812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.359096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.367977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.369764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:01.389181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:01.390065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:01.390883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:01.391442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 272/536] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:01.397137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.415394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdd06d-9e5f-4016-8d6d-132ab23c0443 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.477349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.478592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.479072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.479563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.494364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.496120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:01.515583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:01.516901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:01.517730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:01.528602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 265/537] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:01.532575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.589310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb178-3b64-4bdf-858b-497bf0e07bea None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.644417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.645079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.645352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.645624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.646401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.646702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.648138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.669458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 273/538] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:01.675018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.719632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288df8-97c3-435b-ba7e-d8f69e3ccc7d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.798199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307f79c-bda6-41de-b585-d8f119d186fa None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:01.801613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.802537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.802811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.803073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.803846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.804145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.810782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.833423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 266/539] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:01.842804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:01.857615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:01.858283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:01.858578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:01.859952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:01.860842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8055b211f0f48ee89f209dacd33837c) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:01.861158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:01.863014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257035-82e3-4528-9a80-0fd55c8d1d7c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:01.869774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 274/540] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/role_assignments?user.id=f8055b211f0f48ee89f209dacd33837c&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:01.999831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f744-7658-48fa-b27c-49dd6889d80c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:02.040932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:02.041977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.042344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.042622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.043468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=fddb5e13094f454283de3020e1febc61) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:02.043768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:02.045882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364adfc-e619-4fc7-8e71-eaec92d56fea None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:02.057063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 267/541] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:01 2022] GET /identity/v3/role_assignments?user.id=fddb5e13094f454283de3020e1febc61&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:02.602295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fbca-4dd3-405d-8c81-ce1ba257f48c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.602808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fbca-4dd3-405d-8c81-ce1ba257f48c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.602808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fbca-4dd3-405d-8c81-ce1ba257f48c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.604432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 275/542] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:02.609670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.610075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.610272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.631655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:02.632890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:02.713250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 268/543] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:06:02.747427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696fbca-4dd3-405d-8c81-ce1ba257f48c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:02.866897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696fbca-4dd3-405d-8c81-ce1ba257f48c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:02.900426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:02.901231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.901511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.901785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.912329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-50d26045-a108-422b-995c-2ef2d4fbdd6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:02.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:02.921987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:02.922784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 276/544] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:02.928807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:02.948310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248dd2-5350-46d0-802b-4c862bbe11c9 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.948998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248dd2-5350-46d0-802b-4c862bbe11c9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.949481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248dd2-5350-46d0-802b-4c862bbe11c9 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.951335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 277/545] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:02.956462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:02.957016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:02.957512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:02.982197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:02.985022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:03.082085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9774a-f570-403a-8820-036c44ace290 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.098661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 278/546] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:06:03.132811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.133859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.134365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.134843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.135785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:03.136304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.137972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.151721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 269/547] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:03.157154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.157602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.326485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20bca7-88ed-440c-ad54-1d678eba3a8d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.362175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdec1-c2ac-40f2-93f7-dbfbc06f3f31 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.364668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.365646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.366158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.366558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.379006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:03.388480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:03.389543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:03.390546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:03.393673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 279/548] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:03.405313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.427057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.427836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.428120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.428418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.465284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.467356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:03.509682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:03.510610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:03.511437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:03.511437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:03.511437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:03.511437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:03.511437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 270/549] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:03.512154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8837b-4aa2-4acd-86de-c5026fda6cd2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.517170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.547075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.548108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.548621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.549095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.550033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:03.550559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.552430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.560899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 280/550] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:03.566762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.676325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0c9c-d2a3-4d0a-bdeb-db1b8521cf97 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.711706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b3785-46d9-48d9-a547-a457add079d7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.750483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.751293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.751575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.751849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.756050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.756752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.757035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.757308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.758025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:03.758327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.759700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.775179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.776672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.787720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 271/551] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:03.793704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:03.807603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:03.808514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:03.809357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:03.809357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:03.809357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:03.809357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:03.813702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 281/552] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:03.819263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:03.926618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ce8d8-0caa-4a9a-ba4c-5c58198f8686 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.946204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e926e-9518-4a3a-8dcc-f8ac11e99b08 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:03.963107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.964161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.964636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.965053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.973513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.975265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.987494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:03.988153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.988473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.988752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:03.989472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:03.989773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:03.991125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0ac9db0e-49e2-41d1-9b66-88f7207cda44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:03.993109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:03.993981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:03.994861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:03.997493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 272/553] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:03.998950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d24a-e4b4-458e-b3c4-52c75a1ef8c5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:03.999481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d24a-e4b4-458e-b3c4-52c75a1ef8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:03.999954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d24a-e4b4-458e-b3c4-52c75a1ef8c5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.001669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 273/554] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:04.002606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2d24a-e4b4-458e-b3c4-52c75a1ef8c5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.003154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 282/555] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:04.013377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.126721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508b3d-301e-460b-805f-e69196153a9d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.132209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2d24a-e4b4-458e-b3c4-52c75a1ef8c5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.167465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.168543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.169050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.169162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.169611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.170022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.170375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.170722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.171157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:04.171627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.173261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b6f5-2ec5-4a22-b168-a737641bb320 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.179666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.181472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.191789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 274/556] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:04.193430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.193908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.194352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:04.199314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:04.200199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:04.201720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:04.204443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 283/557] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:04.205405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.217436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:04.218897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:04.296506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 275/558] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:04.296506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.353362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b9cb-9a8d-4ca3-abee-ca605434fd4c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.394989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.395813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.396094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.396396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.408746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.410531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.416407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c275-d15f-4354-9cc4-a87c0a534594 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:04.429866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:04.430704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:04.431523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:04.431523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:04.431523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:04.431523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:04.433821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 284/559] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:04.434972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.451532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.452207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.452527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.452953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.453911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:04.454354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.456015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.474069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 276/560] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:04.475194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.542804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc699-356e-4925-bdb9-2dc09bb38f98 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.576473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f2c7-0e86-4b26-bb18-61796fd74e2e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.581830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.582635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.582915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.583188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.594592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:04.602726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:04.603678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 285/561] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:04.605237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.615879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.616567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.616851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.617126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.617826 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:04.618126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.619479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad15ea-a9a3-4947-aee1-65cc9e1c2339 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.630716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 277/562] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:04.632051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa18-73c8-4430-b4e0-2e6414741215 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.632438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa18-73c8-4430-b4e0-2e6414741215 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.632788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa18-73c8-4430-b4e0-2e6414741215 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.634073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 278/563] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:04.634975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fa18-73c8-4430-b4e0-2e6414741215 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.707366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487332a-23e9-4d89-b1ea-c7ba66ebb7ec None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.737352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fa18-73c8-4430-b4e0-2e6414741215 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.741256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.741908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.742190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.742474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.769228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.769893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.770162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.770434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.771162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:04.771463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.772883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.781113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 279/564] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:04.781742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.808548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.810013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a9c69-719e-4589-9f26-8430d2622ae2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.875433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f4d3-d8e5-451f-bb9d-e36bef5051b6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:04.900933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 286/565] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:04.902215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.902488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.902768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.911396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:04.912187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.912506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.912778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.918459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:04.919393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:04.919657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:04.920866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-39a717d8-93c4-4cf1-9330-a7eaa7343556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:04.935379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:04.936520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:04.937467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 280/566] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:04.938009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139145d-f9a6-46a2-b3f9-601d5af8b0ad None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:04.938078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139145d-f9a6-46a2-b3f9-601d5af8b0ad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:04.938375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139145d-f9a6-46a2-b3f9-601d5af8b0ad None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:04.939625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 281/567] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:04.940321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139145d-f9a6-46a2-b3f9-601d5af8b0ad None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:04.987810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 287/568] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:04.988417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.036264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139145d-f9a6-46a2-b3f9-601d5af8b0ad None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.067709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.068523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.068809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.069076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.079021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.080493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.082136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef779f6-81b2-4508-8e7c-fd88bad9665d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:05.097867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.098905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.099953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:05.099953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:05.099953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:05.099953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:05.100500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 282/569] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.101431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.113956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.114765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.115036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.115302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.124769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.126183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b78a9d4f-4eb3-43ac-9519-adc595652e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:05.143389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.144470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.145344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:05.145344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:05.145344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:05.145344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:05.145344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 288/570] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.145766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.146046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.146316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.162871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:05.164022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:05.197263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9c04-08fb-490d-912b-5111c5fc79f7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.224434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 289/571] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:05.225231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.229380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.230027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.230305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.230577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.231345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:05.232304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.233758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.245207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 283/572] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:05.246256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.321841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa42e-6270-40ae-88d4-7ceb41530000 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.341622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfbcf-597a-43fc-b2ec-5806152b4652 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.354761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.355555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.355834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.356105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.366383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:05.374076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.375169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:05.376287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:05.377202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.377202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.377202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.377202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.377828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:05.378159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.379543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.380196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 290/573] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.380961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.391178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 284/574] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:05.392077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.503450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f368-9e84-4494-b124-1f35c0a7bb47 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.506204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48d83f-cb25-4977-908e-59f7c7b91d34 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.534309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.534955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.535233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.535505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.536210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:05.536548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.537902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.538655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.539433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.539710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.539979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.549676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 291/575] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:05.550484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.555089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:05.563058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.564051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:05.564897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 285/576] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.565587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.643231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa56-bf78-42bc-b0b1-708c18c3f128 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.657782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e748a-364d-4c59-9e18-7a039ba1b5f9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.674708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.675580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.675855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.676131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.688532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.689178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.689456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.689725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.689824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=1222910d5aea4308ae5083faf6bc753a, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.690451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:05.690749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.691244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.692106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.699678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 286/577] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:05.700977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.781992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 292/578] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:05 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:05.782735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.801525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef92d9-28cf-4acc-9ada-a11995a09264 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.836636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.837463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.837744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.838106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.847025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.848591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:05.864178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.865370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 287/579] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.871510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.890618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b09a-40e8-45f5-b327-92db9f40d59a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:05.929069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:05.929886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:05.930155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:05.930434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:05.937607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:05.939239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:05.953949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:05.955111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 293/580] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:05.956016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:05.985596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3f5d6-ddf3-441e-8b7b-f7f069aa029a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.018573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.019294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.019576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.019847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.020669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.020981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.022332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.030602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 288/581] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.031388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.061485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8737b5-d638-4c4d-ad83-f823797d1815 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.094229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.095019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.095302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.095576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.106075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.107616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:06.124770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:06.125698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:06.126602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:06.126602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:06.126602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.126602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:06.126602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 294/582] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:06.126878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.134126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca50d7-829a-4cfe-824e-b2d1b54168f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.166666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.167327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.167605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.167875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.168733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.169071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.170489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.192300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 289/583] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.192300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.230758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5b8a-7392-4577-a445-b97fe9139aa1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.263654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.264306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.264618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.264893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.265675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.265980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.267417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.279072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 295/584] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.279850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.296679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53693-b365-469b-ba7b-633970acce16 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.339510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.340271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.340587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.340885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.353162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.354609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:06.371884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:06.373339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:06.374208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:06.374208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:06.374208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.374208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:06.374208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 290/585] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:06.375680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.380881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0b23f-b83c-499a-9255-9b08102cffd4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.414240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.414902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.415183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.415455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.416165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.416502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.417856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.434032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 296/586] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.434032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.475775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94a770-01a0-46fd-baad-bf16c4373300 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.509465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.510260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.510536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.510810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.520483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.521921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.526867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fa0c2-5836-4565-b24c-e449db1a122e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:06.539149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:06.540063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:06.541372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:06.541372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:06.541372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:06.541372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:06.541372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 291/587] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:06.541664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.565175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.565831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.566110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.566389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.567213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=cb8f96204ad44d3888970d5335afad3e) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.567522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.568968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.582574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 297/588] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/role_assignments?user.id=cb8f96204ad44d3888970d5335afad3e&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.582574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.654844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c16f-7f28-45de-9d1f-ff9df8048170 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.688512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a57c0-1e00-44bb-a429-43648badbf9f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.692330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.692732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.693107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.693474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.694294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.694715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.696202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.708554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 292/589] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.709628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.726319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.727384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.727887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.728342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.738192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.739982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:06.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:06.756946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:06.757870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:06.760538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 298/590] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:06.762011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.815725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad685b-a43e-49f8-998f-a0c03936279f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.849166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.849820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.850096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.850366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.851071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:06.851368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.852754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.864419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1d6f8-4bbc-465b-8f13-94a69d6f87b2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:06.865094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 293/591] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:06.865989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.899049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:06.900224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:06.900740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:06.901233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:06.909875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:06.911602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:06.928145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:06.929170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:06:06.930094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:06.932500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 299/592] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:06.933539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:06.971458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1dbfd-6123-40cb-bad5-7f26c0cff49e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.005650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.006315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.006598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.006869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.007686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:07.007988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.009544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.027493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 294/593] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:07.028971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.034559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df6625-364e-4b7c-a3e4-dec43fbcf593 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.068031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.069194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.069697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.070170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.077177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.078813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:07.096512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:07.097568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.098657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:07.104842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 300/594] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:07.105098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.134389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed107-1d8d-46df-8a95-10040a4336b1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.168784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.169718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.170146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.170565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.171539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:07.172038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.173715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.191504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 295/595] 10.222.0.21 () {56 vars in 1139 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:07.192550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.205218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c3af-5e82-40b6-ab1a-037b448ed76a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.239231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.239820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.240107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.240405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.250748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.252229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:07.270618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:07.271542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:07.272447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:07.272447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:07.272447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:07.272447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:07.276645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 301/596] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:07.277508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.298303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35be75-298d-4ef3-9a74-6d8fa019dead None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.344191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.345245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.345730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.347032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.348542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:07.349138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.350753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.366680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 296/597] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:07.367788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.390923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d011f-6a78-4c7a-bb57-5fe4606ffea6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.425012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.425906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.426192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.426521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.437056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.438565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:07.457770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:07.458698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:07.459560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:07.459560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:07.459560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:07.459560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:07.459560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 302/598] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:07.460287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.498233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c233a-a8c1-42c6-8b8a-a9612ae33b6d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.532859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.533449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.533733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.534009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.534719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:07.535023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.536392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.552623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 297/599] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:07.553703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.581769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b1e12-b48e-4f1a-8988-f317de79daca None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.625060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.626347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.626850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.627299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/e0e3a64bbcfa4449b4aba61a201c1c3b/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.646978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=e0e3a64bbcfa4449b4aba61a201c1c3b, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.649458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.654485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92012ff3-1cae-4ad0-b36a-f03e01c8a554 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.688445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.689037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.689325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.689603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.690318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:07.690623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.691985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.706980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 303/600] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:07 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/e0e3a64bbcfa4449b4aba61a201c1c3b/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:07.708291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.713334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 298/601] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:07.718823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.820014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf6cde-2b0b-4a10-9b50-503a589f6cc9 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.855583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.856932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.857439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.857942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.866301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.868651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:07.884499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:07.885468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.886448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:07.889702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 304/602] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:07.895580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:07.912268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208efc-bddb-400c-aa0f-d49a5eaae9d8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:07.959802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:07.961566 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:07.962299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:07.962797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:07.972038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:07.974209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:07.993957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:07.994905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:07.995799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:07.998552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 299/603] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:08.004941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.069693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92c19-866d-49e0-ac8b-7a84d3d23211 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.102883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.103549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.103835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.104111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.104646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde093-92cf-4f75-af36-94b7812f2f54 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.104933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:08.105245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:08.107232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:08.122738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 305/604] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:08.128345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.139864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.140558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.140838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.141109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.141887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:08.142195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:08.143612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ee25-06ed-4255-bec1-902b6ce4de20 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:08.155868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 300/605] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:08.157190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1bec-cc2a-4b72-bb10-6d3a3bc1af68 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.157486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1bec-cc2a-4b72-bb10-6d3a3bc1af68 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.157794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1bec-cc2a-4b72-bb10-6d3a3bc1af68 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.159327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 301/606] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:08.163561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be1bec-cc2a-4b72-bb10-6d3a3bc1af68 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.233082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50393d9-f469-4eb8-a016-a5853146de16 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.266903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.267789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.268076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.268346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8055b211f0f48ee89f209dacd33837c/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.269896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be1bec-cc2a-4b72-bb10-6d3a3bc1af68 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.283628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=f8055b211f0f48ee89f209dacd33837c, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:08.285094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecf18-539b-4a9f-b6b5-71472dc5953a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:08.306650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.307830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.308273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.308956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/fddb5e13094f454283de3020e1febc61/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.325086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=fddb5e13094f454283de3020e1febc61, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:08.326773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:08.375653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 306/607] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:08 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8055b211f0f48ee89f209dacd33837c/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:06:08.385904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.386282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.386657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.414149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 302/608] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:08 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/fddb5e13094f454283de3020e1febc61/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:06:08.415372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:08.416819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:08.511159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 307/609] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:08.559153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.676806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac96f9-e97a-4af1-b097-3d7d9ebbecab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.727692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.728753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.729172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.729584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.749234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:08.757507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:08.758606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:08.759611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:08.761680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 303/610] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:08.768037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.909014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84e8-60af-45e2-b782-883c2c82669a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:08.943185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:08.943826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.944106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.944393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.945150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:08.945451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:08.946818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468bac2-dbdf-481b-81af-ba22b398aa9b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:08.956256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 308/611] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:08.962627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:08.989980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e988-7773-4477-95c9-9cafec4cfa84 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.990332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e988-7773-4477-95c9-9cafec4cfa84 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.990540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e988-7773-4477-95c9-9cafec4cfa84 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:08.992022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 309/612] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:08.998164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:08.998448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:08.998724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.029795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:09.030897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:09.113902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7369-bada-4831-bb16-5438d72b045a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.145749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 310/613] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:06:09.167139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.167941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.168226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.168527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.173526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.183261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:09.185564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:09.203691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:09.204763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:09.205840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:09.205840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:09.205840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:09.205840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:09.207460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 304/614] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:09.212924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.282117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c92b2-9006-4462-b26d-4afdc5aa040f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.348167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.352470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.352470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.352470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.367559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:09.376115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:09.377360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:09.378468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 311/615] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:09.379284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33eceb-1561-4532-941f-8b62cd09939b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.390279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.450447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.451107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.451389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.451660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.452388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:09.452690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:09.454054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:09.479434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 305/616] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:09.486401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.556352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22b210-e497-4372-aa18-d81a7f4451aa None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.603759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.604450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.604735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.605008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.605757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:09.606058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:09.607964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:09.633848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 312/617] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:09.637499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1850ca-6a7d-4543-8cfe-2b3d3fa7bbd0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.641809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.724480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.725554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.725974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.726384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.748999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:09.750727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:09.764908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e82656-cf9a-409f-8932-068c2c34b249 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:09.768968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:09.769905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:09.770815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:09.773677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 306/618] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:09.780747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.819512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:09.820672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:09.822039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:09.822513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:09.842364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:09.844293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:09.878022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:09.878955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:09.879830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:09.879830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:09.879830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:09.879830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:09.885490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 313/619] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:09.891399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:09.954342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ae44b-d41c-4bf8-921c-3d9a5bd03df1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:09.999259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47948f8-e48f-4a0b-ac8f-0ea5d23c525d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.001654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.002336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.002618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.002891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.004041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:10.004041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.005509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.033051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 307/620] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:10.035781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.036703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.037277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.037744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.038495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.038979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:10.039484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.041064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.058976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 314/621] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:10.061116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.137311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec6e3-c2f6-4c34-92f9-f072f21c2c78 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.159348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d59a56-5363-4c3a-8145-3aed28196b03 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.186118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.186776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.187058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.187328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.196129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.197272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.197782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.198250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.206123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.209360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:10.227517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:10.228541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:10.229552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:10.236458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 315/622] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:10.238397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.260439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.261778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.347885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31e785-d1b9-4839-bc5a-88d9c742daca None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.360865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 308/623] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:10.366209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.384379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.385380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.385877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.386356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.387479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:10.387986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.389723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.411594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 316/624] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:10.413153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.515638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f7e17-736d-4451-8cd0-06c1d75aff31 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.533955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c273e-9831-4444-b1c9-1b5ec850b875 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.550647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.552148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.552652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.553126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.563383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.565288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.568534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.569221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.569495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.569756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.579975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.581435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:10.586472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:10.587365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:10.588244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:10.588244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:10.588244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:10.588244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:10.595274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 317/625] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:10.596724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:10.599547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:10.600416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:10.602416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:10.602416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:10.602416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:10.602416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:10.602416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 309/626] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:10.606789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.705403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b658a-be7f-4c66-a033-c8cc3ef6b328 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.722076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd147f45-577a-4fa7-89c5-83ecd317d190 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.739799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.740507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.740792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.741060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.741777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:10.742092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.743441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c98ed8-ca32-4da1-a864-ee9b7be7d5b2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.755171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 310/627] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:10.759095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.759995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.760597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e6be-1d5a-4e11-affe-8acfed4d7c5f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.760815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.760913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e6be-1d5a-4e11-affe-8acfed4d7c5f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.761177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e6be-1d5a-4e11-affe-8acfed4d7c5f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.761662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.762635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:10.762997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 311/628] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:10.763438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.764104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860e6be-1d5a-4e11-affe-8acfed4d7c5f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.765280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc62cf-f4d8-4208-82a5-f3101195071f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.782676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 318/629] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:10.784229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.784706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.785122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.802615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:10.803994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:10.870195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860e6be-1d5a-4e11-affe-8acfed4d7c5f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:10.874520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 319/630] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:10.875840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.906275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:10.907248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:10.907637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:10.908154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:10.915020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:10.916618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:10.931809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:10.932911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:10.933907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:10.935770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 312/631] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:10.936781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:10.981330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf9ac4-46cc-42b5-a640-bd1fbfc18a3a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.021669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.023176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.023645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.024081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.031812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.033479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.041258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf40d-d4d8-4bb5-9276-6e42360f54e6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:11.047894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:11.048883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:11.050045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:11.056784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 320/632] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:11.057799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.078499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.079297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.079581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.079857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.089921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:11.098304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:11.099322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:11.100264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:11.101625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 313/633] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:11.102557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.158776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d12e92-e4da-425b-a94f-a3261d2138a1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.190766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.191426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.191705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.191975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.192781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:11.193087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.194518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b601a-509d-4be5-909c-7fdc414b93aa None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.207500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 321/634] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:11.209060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662aad-5a97-4349-9a87-83954963b09d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.209344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662aad-5a97-4349-9a87-83954963b09d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.209616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662aad-5a97-4349-9a87-83954963b09d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.215148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 322/635] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:11.215148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662aad-5a97-4349-9a87-83954963b09d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.215454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753930f7-9e76-451b-9036-e109242439f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.250701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.251382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.251664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.251933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.252735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:11.253038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.254472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.272556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 314/636] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:11.272556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.323437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662aad-5a97-4349-9a87-83954963b09d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.360277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.360971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.361250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.361535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.362470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:11.362584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.363897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1607a74-6cb8-4fb7-aa16-74cdf1590233 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.372587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 323/637] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:11.373798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.374081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.374356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.382843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586d44-e165-472f-a2a6-0a55a280f518 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.390975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:11.392138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:11.416515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.417163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.417436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.417702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.418513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:11.418842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.420248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.425812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 315/638] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:11.426855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.458036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 324/639] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:11.459237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.552797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a32c-d13c-443d-9dc2-9caa700578ab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.569361 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d1bc-acd0-47f7-9fac-8a69bbdbcf7e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.590268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.591205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.591478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.591746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/cb8f96204ad44d3888970d5335afad3e/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.605971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.606525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=cb8f96204ad44d3888970d5335afad3e, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.606637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.606831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.607071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.608087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.617742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.619174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e072f8c7-fb76-4563-8d50-3a5875884768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:11.636956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:11.638600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:11.639621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:11.639621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:11.639621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:11.639621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:11.639621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 325/640] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:11.640191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23905-e692-4efc-9884-f8e29df2137d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.640191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23905-e692-4efc-9884-f8e29df2137d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.641179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23905-e692-4efc-9884-f8e29df2137d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.641974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 326/641] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:11.642953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23905-e692-4efc-9884-f8e29df2137d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.685008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 316/642] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:11 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/cb8f96204ad44d3888970d5335afad3e/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:11.685927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.767792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23905-e692-4efc-9884-f8e29df2137d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.810482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.812010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.812801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.813295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.817366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4658a-441c-4d02-a82c-b78863c89cb0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:11.828412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-f08fae1f-eb4d-46bb-b508-bd199d24957f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:11.839539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:11.840774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:11.841672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:11.842325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 327/643] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:11.844272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.844272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.844272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.859795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:11.860533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:11.860814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:11.861086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:11.861817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:11.862120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:11.863811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:11.870703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:11.873284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:11.877321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 317/644] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:11.878426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.956289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 328/645] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:11.958433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:11.987588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6773-aebf-4f26-97d3-506832ba6eeb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.031895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.033350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.034105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.034588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.035551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:12.036248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.038654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.050218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 318/646] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:12.052176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.070314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd692a-1941-4195-847d-8102c1d44e4f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.104237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.105109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.105602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.105709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.113708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.115399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:12.130149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:12.131178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 12:06:12.132543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:12.136161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 329/647] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:12.137126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.185699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1813deb-1249-4d04-9026-05fed99e6d1a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.227812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.229412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.230055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.230720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.238651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e08b3-cf69-412f-be5b-34b56b721d71 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.242959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:12.251072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:12.251991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:12.252879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:12.255515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 319/648] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:12.256520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.273448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.274240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.274522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.274794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.285687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.287251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:12.305721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:12.306721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:12.307614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:12.307614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:12.307614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:12.307614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:12.307614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 330/649] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:12.308536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.373143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20dee3-ee8c-4840-b720-d5ac281462d9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.407057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.407726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.408004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.408276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.409125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:12.409442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.410867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.411657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf1e4-8f99-424e-81a8-77d472218822 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.432414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 320/650] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:12.432414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.458622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.459588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.460043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.460565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.461504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:12.462000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.463628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.472862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 331/651] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:12.474001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.549712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79edad-f5cd-48b3-8b86-02b99046dc25 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.587744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41345-9ad3-4fe3-a1e8-a1dcae12ba3e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.594680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.595346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.595731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.595955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.597190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:12.597408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.598789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.616493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 321/652] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:12.616493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.634250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.635437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.635873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.636330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.712324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.714032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.731340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab527-922c-429f-95e2-ed5d4a19f0cd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.777041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.777827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.779098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.779298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.793222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.794288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:12.811942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:12.812911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:12.813784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:12.813784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:12.813784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:12.813784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:12.813784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 322/653] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:12.814472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.837135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 332/654] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:12.837643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:12.920325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ef60-ad06-4984-ba79-e108ee32a997 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.938078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a453f-9932-40f7-874d-335eb4c7087b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:12.955082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.955929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.956207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.956553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.967094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.969011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.976169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:12.977106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:12.977585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:12.978054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:12.978987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:12.979490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:12.981145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:12.983967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:12.984922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 12:06:12.985846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:12.988510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 323/655] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:12.992523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.000293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 333/656] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:13.001369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.098047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c300bc-407b-46b5-9dbd-a7616dca9b67 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.122169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72e48-fa6e-4ca6-9242-1766a6df964a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.133201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.134253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.134734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.135213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.148107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.149575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.162301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.163284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.163780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.164267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.165342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:13.165844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.167448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:13.167555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:13.168413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:13.169848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:13.169848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:13.169848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:13.169848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:13.173952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 324/657] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:13.174734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.197143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 334/658] 10.222.0.21 () {56 vars in 1139 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:13.197421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.293158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5bff-60e2-468b-adf5-e6726f16234f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.305337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0193f-9480-462e-9266-6db6c68e2f41 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.334948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.339837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.339837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.339837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.346005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.347740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.350614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c142-9604-406e-9a63-421510039d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.351421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c142-9604-406e-9a63-421510039d2b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.351797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c142-9604-406e-9a63-421510039d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.352213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c142-9604-406e-9a63-421510039d2b None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.353070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c142-9604-406e-9a63-421510039d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:13.353456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c142-9604-406e-9a63-421510039d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.354953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c142-9604-406e-9a63-421510039d2b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:13.363807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:13.364832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:13.365981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:13.369753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 325/659] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:13.369753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.378183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 335/660] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:13.378183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c142-9604-406e-9a63-421510039d2b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.473513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c142-9604-406e-9a63-421510039d2b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.484832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d64988-f3b1-4e58-a4ea-00bedbf0a20b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.507730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.508720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.509066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.509401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.510314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:13.510682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.512208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.518609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.519256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.519539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.519814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.530752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 336/661] 10.222.0.21 () {56 vars in 1137 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:13.531677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.592923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.594380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.634388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92cca-61cc-4ffa-a2e8-6b68ceab4f2a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.671775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.672689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.672964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.673232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.680971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.682419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:13.696902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:13.698900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:13.701169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:13.702151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 326/662] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:13.702151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.707163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 337/663] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:13.707163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:13.795773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837c93-6136-44e7-a9f4-e2ff837cfdc7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.829841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ee45-2974-49f0-a64a-2a310f9351cd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:13.832871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.833512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.833788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.834056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.867869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:13.868687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:13.868987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:13.869236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:13.888415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.890338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.908842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:13.910356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec54e7-6e33-4720-be4b-3253d5c95a66 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:13.912378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:13.913435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:13.914331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:13.914331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:13.914331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:13.914331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:13.919220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 338/664] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:13.920078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.015931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6aaa-4dee-47d0-b4c2-e1936b659c3b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.020717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 327/665] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:14.022707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429f9a-5c6a-41d7-9870-362f152b60e3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.022707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429f9a-5c6a-41d7-9870-362f152b60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.022899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429f9a-5c6a-41d7-9870-362f152b60e3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.024278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 328/666] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:14.029450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429f9a-5c6a-41d7-9870-362f152b60e3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.049724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.050305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.050583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.050855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.051903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.052206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.053646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.065652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 339/667] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:14.066751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.135781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429f9a-5c6a-41d7-9870-362f152b60e3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.159930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b166d0-16cd-4cc1-bb44-852d5dac6166 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.168304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.168982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.169259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.169528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.170228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.170526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.171877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcc396-d6ae-4775-91be-9084cb84d3f4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.182914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 329/668] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:14.184576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76eb5-2710-455f-b63b-6bc8442d3da1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.184989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76eb5-2710-455f-b63b-6bc8442d3da1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.185266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76eb5-2710-455f-b63b-6bc8442d3da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.195525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.196324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.196653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.196931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.201511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-22a76eb5-2710-455f-b63b-6bc8442d3da1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:14.202676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-22a76eb5-2710-455f-b63b-6bc8442d3da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:14.207255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.208747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:14.226392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:14.227465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:14.228639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:14.228639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:14.228639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:14.228639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:14.228639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 340/669] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:14.228968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.271674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 330/670] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:14.273201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7463043-a6fa-4cc2-808d-6e3d7f9270c0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.273553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7463043-a6fa-4cc2-808d-6e3d7f9270c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.273909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7463043-a6fa-4cc2-808d-6e3d7f9270c0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.275219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 331/671] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:14.275898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7463043-a6fa-4cc2-808d-6e3d7f9270c0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.327740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76479180-07a5-4d5b-927f-91111de5c519 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.361007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.361663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.361945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.362217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.363040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=e0e3a64bbcfa4449b4aba61a201c1c3b) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.363351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.364796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.370378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 341/672] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/role_assignments?user.id=e0e3a64bbcfa4449b4aba61a201c1c3b&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:14.371147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.374991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7463043-a6fa-4cc2-808d-6e3d7f9270c0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.411709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.413122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.413407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.413682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.421204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.422703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a88428c2-ecfe-4df0-a904-30b50f17d6c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:14.438710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:14.439863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:14.440917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 332/673] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:14.441786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.441882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.442134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.460536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:14.461923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:14.486654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a748-2d10-4e7a-b02c-16e8e858c254 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.529671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.530700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.530987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.531268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.532197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.532874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.534573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.537281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 333/674] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:14.538263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.561794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 342/675] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:14.562662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.649443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450f20-f7fa-49f9-a7a6-bc4f03c15e58 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.666490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea36ed-25e0-4800-80ea-b3fb06828d06 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.682460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.683263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.683548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.683824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.694795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:14.701401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.702058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.702339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:14.702440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:14.703345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:14.709247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:14.709889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.709889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.709889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.710087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 334/676] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:14.710087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.710219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.716771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 343/677] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:14.720530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.806755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00355-7348-490e-98af-17ca619ad6f8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.817640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78819dfc-5460-4971-b577-dd804e29a30a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.839298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.840093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.840428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.840710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.849208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.850281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.850674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:14.850985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.851461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.858951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:14.859161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:14.860233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 335/678] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:14.866175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.867163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:14.879869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:14.887273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 344/679] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:14.889596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:14.958815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64caecaa-4447-4594-a8be-c06dd3b51c73 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.977301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ca21-c61c-41ad-933f-149a05dcaf07 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:14.990602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:14.991263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:14.991546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:14.991901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:14.992570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:14.992876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:14.994282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.002742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 336/680] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.003529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.012118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.013104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.013613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.014428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.015786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=fddb5e13094f454283de3020e1febc61) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.016716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.018874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.026220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 345/681] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:14 2022] GET /identity/v3/role_assignments?user.id=fddb5e13094f454283de3020e1febc61&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.027654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.108599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698514-7e7e-4052-b41a-abe776962b1d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.149115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.149881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.150069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.150348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.151100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.151407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.153372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.162561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 337/682] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.163606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.170947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b356e-6862-4f01-a6fc-e4787a00177b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.218719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.219741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.220761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.221246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.222545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.223225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.225594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.241041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 346/683] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.242161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.280627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd7338-9181-454c-a594-0d244b2756e6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.323787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.324676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.324963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.329100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.338367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.339913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:15.361678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:15.362616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:15.363491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:15.363491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:15.363491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:15.363491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:15.363491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 338/684] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:15.364354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.382608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa49c6c-0e2d-41ed-bc41-c3be0fd1bf67 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.422810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.423948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.424450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.424927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.436185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.437949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:15.455933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:15.456880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:15.457768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:15.457768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:15.457768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:15.457768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:15.459996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 347/685] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:15.461143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.467079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df301c8-20e4-45ac-89be-a1be7f1bce27 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.501265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.501840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.502131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.502407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.503236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8055b211f0f48ee89f209dacd33837c) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.503548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.505036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.520550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 339/686] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/role_assignments?user.id=f8055b211f0f48ee89f209dacd33837c&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.521794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.606926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0ba3-b299-4b54-a039-7a5c7c56a772 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.684807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf541b-e1f3-45fb-b9c9-820467d9c073 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.685162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.685846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.686132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.686414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.687157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.687462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.688943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.716623 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 348/687] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.721866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.727936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.728665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.728948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.729212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.729938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:15.730240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.731960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.748468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 340/688] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:15.753808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.858959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e746a-e526-4847-9e95-6311b87f58ff None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.872767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf1652-1c0b-4d07-ab8d-76742fc2d0aa None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:15.896834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.897634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.897907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.898188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.906515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.907983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.913320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:15.914132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:15.914411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:15.914823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:15.923232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:15.923546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:15.925343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:15.926789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:15.927456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:15.927539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 349/689] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:15.932385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:15.949079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:15.951191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:15.952404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 341/690] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:15.956490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:16.042691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed86e1-715e-42cc-81c5-5ede1679fb90 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:16.079482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:16.080154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.080460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.080736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.081575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:16.081754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002268-1c10-4b25-ad20-850e032c9929 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:16.081929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:16.083287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:16.100405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 350/691] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:16.105815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:16.124328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:16.127225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.127507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.127782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.128645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:16.128954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:16.133268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:16.169192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 342/692] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:16.170084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:16.308808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1ec5f-3e28-4c14-aac4-0dd4d43300b5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:16.349097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:16.349764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.350050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.350323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.353080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85653-df38-4afb-b1d2-7a91376d454b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:16.422775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:16.423945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:16.485622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:16.486649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.487140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.487649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.557488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 343/693] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 12:06:16.568390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:16.667503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:16.669604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b442e1d-c3b4-4c5b-a212-941c0f3e8554 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:16.771782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e5e-e59b-4acf-837c-e04ace6f03b0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:16.814522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:16.815324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.815607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.815881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.829245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:16.831151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-271e0ee7-41b7-44c3-8abf-4ce911461dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:16.849586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:16.850520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:16.851402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:16.851402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:16.851402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:16.851402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:16.851402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 344/694] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:16.852470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6889-694b-4f83-9e7d-7067a59b57e9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.852758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6889-694b-4f83-9e7d-7067a59b57e9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.853034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6889-694b-4f83-9e7d-7067a59b57e9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.860479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 345/695] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:16.860479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b6889-694b-4f83-9e7d-7067a59b57e9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:16.908392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 351/696] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 12:06:16.911253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:16.911253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:16.911253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:16.930729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:16.932266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:17.006489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b6889-694b-4f83-9e7d-7067a59b57e9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.044386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 352/697] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:17.044386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.099973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.100597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.100882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.101157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.101875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:17.102178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.103553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.115200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 346/698] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:17.116029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.194697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7af8-99a8-466c-b95c-669bdeaf2302 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.226831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862046-ef82-4c3c-a3a9-f2e804eda3a4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.231858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.232686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.232968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.233239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.243613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.245186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.260323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.261130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.261404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.261666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:17.263476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:17.265536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 353/699] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:17.267620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.276488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.276488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:17.292078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:17.294171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 347/700] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:17.296262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.377480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b60193-7764-4713-87d7-3d20c889a6de None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.394151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216e83-5872-467b-8c90-9c6104f3f9a2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.413188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.414286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.414793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.415321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.422693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.424352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.427637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.428298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.428599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.428869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.429574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:17.429878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.431236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:17.441460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:17.442444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:17.443340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:17.444338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 348/701] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:17.445343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.451778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 354/702] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:17.453084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.545436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab376d-6e6d-46c1-9d23-2fbf926f7bbb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.555541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1ba5-a099-4a80-83ca-c3b3df4c1845 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.579810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.580462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.580744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.581015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.581723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:17.582023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.583398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.591932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.593086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.593614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.594078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.600165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 349/703] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:17.600165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.606402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.608055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:17.623769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:17.624909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:17.625928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:17.627985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 355/704] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:17.628972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.700300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc0e1-0608-4352-90c9-6255912ce190 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.728048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcc6c-7856-401a-8d0e-9b58814ac0d0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.734496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.735155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.735438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.736133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.736954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:17.737269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.739399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.758454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 350/705] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:17.759320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.762035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.762710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.762986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.763253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.763959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.765416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcdf13-f3a9-497e-b849-c10c43313e9d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.845696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 356/706] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:06:17 2022] POST /identity/v3/users => generated 254 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:17.847550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31de8-dff4-42c1-962c-a2834a0f7242 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.848029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31de8-dff4-42c1-962c-a2834a0f7242 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.853705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31de8-dff4-42c1-962c-a2834a0f7242 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.855494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 357/707] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:17.855605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19737e-380b-46d2-b04b-0ee751cb2661 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:17.857119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31de8-dff4-42c1-962c-a2834a0f7242 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:17.894590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:17.895180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.895440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.895713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.896512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:17.896814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:17.903043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b20f-3e85-4432-9f56-e081330479f4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:17.910636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 351/708] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:17.911937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:17.912228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:17.912537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:17.930540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:17.931757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:18.010164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 352/709] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:18.011948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.020694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31de8-dff4-42c1-962c-a2834a0f7242 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.057771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.057771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.058081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.058471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.059410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=cb8f96204ad44d3888970d5335afad3e) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:18.059781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.061421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.076632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 358/710] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:17 2022] GET /identity/v3/role_assignments?user.id=cb8f96204ad44d3888970d5335afad3e&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:18.077801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.142424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716b0b-5f42-4360-8857-06287c195f2f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.188496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.189485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.189968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.190427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.191452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:18.191956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.193680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.200486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 353/711] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:18.203426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6665-28fa-4b29-89f4-e3734753aeba None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.245065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.245892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.246172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.246486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] PATH_INFO: `/v3/services/network` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.247169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.248612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-617f5ebe-ff54-4a0c-83af-6472b9702536 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:18.263253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:18.264357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.265247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 359/712] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:18.271267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.390698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab36c-3ed0-4fe8-a1fb-3b32a2e25d93 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.408766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ec6d-b1c5-40ca-b84a-1fce0a78f01c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.409802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ec6d-b1c5-40ca-b84a-1fce0a78f01c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.410293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ec6d-b1c5-40ca-b84a-1fce0a78f01c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.412236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 360/713] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:18.417998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.418560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.422522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.434429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.435104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.435388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.435662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.436388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] RBAC: Adding query filter params (name=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:18.437461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.438438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.439380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:18.441024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:18.444105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 354/714] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:18.455140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.531461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 361/715] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 12:06:18.555495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.582537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa541-6f2c-4564-bb4a-24676959b06b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.623262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.623936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.624222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.624529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.625236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] RBAC: Adding query filter params (type=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:18.625541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.626973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.633479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 355/716] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:18.664808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead6e20-b2cc-4bd9-b259-2d7f4edab726 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.702788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.703896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.704338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.704791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.705615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.707237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:18.721368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:18.722576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:18.723681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:18.726323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 362/717] 10.222.0.21 () {56 vars in 1129 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:18.732660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:18.850078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65c2e-ebca-4ce8-ac19-ce237d17e260 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:18.885231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:18.886167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:18.886640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:18.887650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:18.888522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:18.888969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:18.890542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b5d62-5b76-47d8-9574-f073df0d4b90 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:18.895291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 356/718] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:18.900918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:19.004281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f528da-fb0b-44cd-b36c-8e8bee3ae4f4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:19.038042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:19.038955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:19.039380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:19.039821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:19.040710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:19.041157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:19.042670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d144b-faa4-41ae-9cea-5b9de4006241 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:19.048756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 363/719] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:21.004408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48062-6535-42fd-9849-a79a471e5bc6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.005449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48062-6535-42fd-9849-a79a471e5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.005970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48062-6535-42fd-9849-a79a471e5bc6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.007815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 357/720] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:21.013368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199285-7a8e-4366-b664-1785e839a98d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.014218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199285-7a8e-4366-b664-1785e839a98d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.014695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199285-7a8e-4366-b664-1785e839a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.039374 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-63199285-7a8e-4366-b664-1785e839a98d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:21.040902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-63199285-7a8e-4366-b664-1785e839a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:21.048452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3583d-736a-41a3-a119-708da13b3624 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.048745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3583d-736a-41a3-a119-708da13b3624 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.049022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3583d-736a-41a3-a119-708da13b3624 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.050679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 358/721] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:21.055731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b20ef-70eb-4c51-b6bf-58e6d63c468b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.056019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b20ef-70eb-4c51-b6bf-58e6d63c468b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.056300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b20ef-70eb-4c51-b6bf-58e6d63c468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.077438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2b7b20ef-70eb-4c51-b6bf-58e6d63c468b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:21.080251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2b7b20ef-70eb-4c51-b6bf-58e6d63c468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:21.143879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 364/722] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:21.168526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dacdf-26b1-41bf-836f-2738f3d993f5 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.169131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dacdf-26b1-41bf-836f-2738f3d993f5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.169607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dacdf-26b1-41bf-836f-2738f3d993f5 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.171417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 365/723] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:21.176895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dacdf-26b1-41bf-836f-2738f3d993f5 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.186682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 359/724] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:21.188061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.188357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.188660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.206945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:21.208463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:21.294658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 360/725] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:21.296407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.301141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dacdf-26b1-41bf-836f-2738f3d993f5 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.350135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.351336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.351828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.352318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.364239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:21.373023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:21.373944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:21.374788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:21.377505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 366/726] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:21.378602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.400841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7379d-7472-4d1b-85b9-cc01d8a175cb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.493089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.493896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.494173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.494444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.511949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:21.521863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:21.522812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:21.523650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 361/727] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:21.524340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.531531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb7f9b-7465-48ea-a41e-a71486de036b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.573801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.574639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.574922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.575196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.588134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-192d4644-3d8d-4ac8-bb3d-0530a699e255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:21.598534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:21.599456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:21.600301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 367/728] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:21.604426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6588-c298-4630-9f95-ce33e32fdd84 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.604426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6588-c298-4630-9f95-ce33e32fdd84 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.604426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6588-c298-4630-9f95-ce33e32fdd84 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.606230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 368/729] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:21.606841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6588-c298-4630-9f95-ce33e32fdd84 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.636817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f801-37c1-44df-b003-86227d44b7e1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.672988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.673760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.674044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.674321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.675061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:21.675371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:21.677039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:21.685479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 362/730] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:21.686280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.714199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6588-c298-4630-9f95-ce33e32fdd84 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.747871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.748666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.748953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.749230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.749973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:21.750280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:21.751634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e660d1-811f-46be-b8c2-66be40b5ff1f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:21.764464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 369/731] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:21.764464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.764464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.764464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.779870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:21.781070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:21.790816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e348a3-aade-46fc-8dbe-bfb9fff6af82 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.823564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.824282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.824562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.824835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.825570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:21.825872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:21.827226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:21.834939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 363/732] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:21.839471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.843764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 370/733] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:21.844622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:21.932450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ccb-c3b7-44dd-95cb-f093d470b14f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.937468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9ad97-0e3b-4e3e-8349-20ad4da3629e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:21.963469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.964255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.964568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.964846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.969908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:21.970688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.971019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.971295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.975428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:21.976979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:21.981445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:21.982865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1c7c7e34-6224-484c-af17-076948310408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:21.994098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:21.995288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 364/734] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01e41-e134-4a73-846e-755a414aeeec None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01e41-e134-4a73-846e-755a414aeeec None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:21.997798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01e41-e134-4a73-846e-755a414aeeec None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:21.999595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 365/735] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:21.999595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e01e41-e134-4a73-846e-755a414aeeec None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:22.002768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:22.004481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 371/736] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:22.006258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.097619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8ab3-6cb0-4647-a152-c755a6a514b8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.098225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e01e41-e134-4a73-846e-755a414aeeec None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.129131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.129348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.129777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.130055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.130143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.130326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.130424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.130651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.131033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.132416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb01c8-fd3e-46c2-9c29-aeb24e79a24a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.141480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.142916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:22.160153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:22.161217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 366/737] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:22.162141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.225936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 372/738] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:22 2022] POST /identity/v3/services => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:22.227321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.227607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.227886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.245034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:22.246287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:22.268629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869abd0-456b-4e42-a45d-6a0cfac53824 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.310012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.310683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.310960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.311227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.311942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:22.312241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.313676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.322370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 373/739] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:22 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 12:06:22.322370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.326863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 367/740] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:22.338062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.427676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976facf2-43f0-4d74-8579-74388ce89ce6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.452670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ce7f-0e54-4114-a561-a454bd39b095 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.462003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.462666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.462943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.463212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.463935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:22.464229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.466257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.477458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 374/741] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:22.478267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.486780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.487686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.488144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.488661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.489570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:22.490050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.491583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.502746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 368/742] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:22.503386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.579689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2477f8-5836-438f-b916-45fd1c65e59e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.598593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63a27a-6d16-413e-b671-5e61726c18d8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.610912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.611725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.612004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.612283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.619598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.621073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.630525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.631183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.631463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.631735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.632460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.633802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:22.635750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:22.637541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:22.638576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 375/743] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:22.639208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.716670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 369/744] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:22 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:22.717621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.741181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e375f-e23c-43c8-af2c-2a8ffde4abe8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.839469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc0539-0209-46e0-8093-c4e5da715dce None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:22.879681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.880711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.881088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.881461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.891363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.893034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:22.909537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:22.910762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:22.911858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:22.912885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 370/745] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:22.913820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:22.918633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:22.919724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:22.920159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:22.920641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:22.929548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:22.931188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:22.947077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:22.948079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:22.949083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 376/746] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:22.950688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.029524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d42-f1b6-44da-9c27-0dc62329145b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.054475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d798f-e312-4dba-922c-b30134ac0a52 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.065374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.066373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.066875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.067354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.068411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:23.068925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.070641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.088947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.089682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.089949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 371/747] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:23.090053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.090273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.091214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:23.091474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.091578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.092960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.115544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 377/748] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:23.116523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.192047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5d75-41e7-4e6d-be0f-63504679bb96 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.214777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d84aef-e8a3-4ef0-bf95-fe628f91bf58 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.226275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.227253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.227740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.228225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.229298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:23.229808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.232130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.249041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.249690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.249972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.250248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.251220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 372/749] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:23.252242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.317635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.319082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.351984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f49c8-8d26-46d3-9a65-ca052317bbc4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.387719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.388766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.389216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.390309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.419319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 378/750] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:23.420238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.457809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.459610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.515763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f58a-246f-48c5-8d3c-6eb99ad7d6df None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.550794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.551993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.552273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.552575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.559551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 373/751] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:23.560649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.570150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.571541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:23.591167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:23.592092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:23.593001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:23.593001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:23.593001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.593001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:23.595211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 379/752] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:23.596211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.688545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06d662-d99b-4005-add3-61a11251272f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.694723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4622-4045-4b81-a914-d27e9a464be4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.727007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.728333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.729143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.729877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.734322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.735108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.735387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.735658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.741872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.743984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.746948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.748852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:23.765612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:23.766546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:23.767505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:23.767505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:23.767505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.767505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:23.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:23.769829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:23.770712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:23.770712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:23.770712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:23.770712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:23.771814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 374/754] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:23.773003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.775966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 380/754] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:23.778361 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.885084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e31f-7b99-46bb-9d62-32180a4f1caf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.905265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997e333-9426-4ca1-ad29-4777c8e91429 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:23.920815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.921876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.922364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.922840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.923756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:23.924292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.925919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.939815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 375/755] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:23.941125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:23.948012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:23.948748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:23.949028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:23.949349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:23.950095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:23.950381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:23.951753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:23.966487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 381/756] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:23.967610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.058692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a67e6-4ef0-4062-bb3e-68d0bb9ba226 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.066607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c527844-e0f6-4672-b131-1a829f1f2bec None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.092822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.093292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.093572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.093846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.094560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:24.094885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.096222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.101898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.102954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.103440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.103938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.111725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.113368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 376/757] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:24.113650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.114244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:24.131097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:24.132403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.133306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:24.135796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 382/758] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:24.136918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.212605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eedb4-ce63-4c01-8be5-6d0d93e1cb3e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.237528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4df07d-6d62-4803-805c-66f46c2dac7f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.246859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.247647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.247926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.248200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.254935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.256309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:24.270108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:24.271009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:24.271910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 377/759] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:24.272877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.275656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.276978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.278019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.278516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.286132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.287830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:24.303155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:24.304123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:24.305065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:24.307737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 383/760] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:24.309078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.382207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063866c-f3b4-4f38-b257-047797115ca8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.414888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a3f0-a7bf-4f9f-b1c9-329a1487cfbc None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.416791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.417465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.417729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.418032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.419034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:24.419146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.420564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.433218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 378/761] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:24.434269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.451624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.452671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.453208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.453779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.454806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:24.455317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.457053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.470508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 384/762] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:24.471663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.532818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df321ba-18ba-47e7-a75b-601e632f9760 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.565941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.566600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.566884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.567155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.567929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:24.568236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.569205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b92f-a8eb-454d-a8bb-9bb591b35aa2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.569717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.586095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 379/763] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:24.586095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.606976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.607861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.608140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.608441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.610507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=1222910d5aea4308ae5083faf6bc753a, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.611938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a38a6-8eeb-4d96-a49c-413ae6ffc887 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.678864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913aef3-54dc-4579-9afa-ec3fc1a4cbd5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 385/764] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:24 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdddd-c019-4a06-a671-9d0bffc3e955 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdddd-c019-4a06-a671-9d0bffc3e955 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdddd-c019-4a06-a671-9d0bffc3e955 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 386/765] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:24.684613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafdddd-c019-4a06-a671-9d0bffc3e955 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:24.723491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:24.724159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.724516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.724954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.726102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=5be2f874cbd1473fb0fe6fd0acca1acf) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:24.726417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:24.727934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151734-3205-459e-97fb-0559f02df7ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:24.735018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 380/766] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/role_assignments?user.id=5be2f874cbd1473fb0fe6fd0acca1acf&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:24.736588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:24.736881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:24.737160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:24.773092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:24.779152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:24.904593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 381/767] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:24.919080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafdddd-c019-4a06-a671-9d0bffc3e955 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:24.928490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.006627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.006627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.006627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.006627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.007117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=cb8f96204ad44d3888970d5335afad3e) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:25.007117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.007117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.007117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 387/768] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/role_assignments?user.id=cb8f96204ad44d3888970d5335afad3e&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:25.039336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f8676-7bac-490c-a35e-4504dccc7b60 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.078240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.079491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.079927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.080380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] PATH_INFO: `/v3/services/network` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.081214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.082840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ed4b3132-ead8-472b-aa97-3854586ad161 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:25.098365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:25.099702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:25.100820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.103610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 382/769] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:24 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:25.110522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.174595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019fda-4ecc-4a4b-a2bc-6c559904dce9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.174882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019fda-4ecc-4a4b-a2bc-6c559904dce9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.175159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019fda-4ecc-4a4b-a2bc-6c559904dce9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.176977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 383/770] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:25.187125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.187407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.187675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.209185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:25.210384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:25.283004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 384/771] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:25.287725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13274-486c-4f25-96da-a30694b3572f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.306276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.333324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.334002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.334283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.334558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.335267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] RBAC: Adding query filter params (name=network) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:25.335570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.336982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.347220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 388/772] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:25.348536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.453543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308ce7-1e94-4ae8-b817-dc76bef9b64c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.486820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.487482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.487764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.488037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.488765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:25.489065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.490425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.499099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be20bd-899a-43bc-ad87-92707c187e15 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.499949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 389/773] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:25.504385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.571672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.572572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.572859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.573136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.573793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.575753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:25.596402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:25.597379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:25.598202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 385/774] 10.222.0.21 () {56 vars in 1129 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:25.613301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.614131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcca0-1441-42a5-9801-3ee9b32e76b2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.657001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.657659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.657937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.658209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.658997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] RBAC: Adding query filter params (interface=public, service_id=cee11319aebd47379b0c72b5167cdd73, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:25.659304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.660699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.672471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 390/775] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/endpoints?service_id=cee11319aebd47379b0c72b5167cdd73&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:25.673790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:25.766879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5fcb-d8f6-4416-bd21-ce50f3dee7b5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.786449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85769f9-536b-42b6-a07a-9f6374a1b809 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:25.826322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.826906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.827183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.827449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.828146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:25.828467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.829072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:25.829836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.830171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:25.830646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:25.831127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:25.832023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:25.833583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:25.843480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 386/777] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:25.843753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 391/777] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:25.847557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:26.148023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371628-7909-4e74-ac99-aa55c0b176e7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:26.191848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:26.192976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:26.193494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:26.193997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:26.194958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:26.195474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:26.197109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:26.207531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 387/778] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:26.209213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:26.309422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2567-da61-45cd-831e-b3e5fee21db0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:26.343108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:26.344116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:26.344658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:26.345161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:26.346156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] RBAC: Adding query filter params (interface=public, service_id=0d52894492144039b1b1d46bdb7e8c12, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:26.346675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:26.348288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8d1f3-5e91-4187-9314-a05e9bc92957 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:26.357130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 392/779] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:26 2022] GET /identity/v3/endpoints?service_id=0d52894492144039b1b1d46bdb7e8c12&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:26.360168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:26.464396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb77f6-5420-4310-ac1d-96953366288e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:26.506894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:26.507593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:26.507877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:26.508213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:26.508920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:26.510278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf7a6-aabb-4bf1-b81b-282053d3091e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:26.517101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 388/780] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:26 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:27.338751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41874e2-94e7-45cc-9df8-ab2944508920 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.340149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41874e2-94e7-45cc-9df8-ab2944508920 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.340600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41874e2-94e7-45cc-9df8-ab2944508920 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.342331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 393/781] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:27.348242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.348753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.349173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.373601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:27.375464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:27.457185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531aceb-b7dc-4d16-a492-7b159c66bbd2 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.457843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531aceb-b7dc-4d16-a492-7b159c66bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.458322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531aceb-b7dc-4d16-a492-7b159c66bbd2 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.460129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 394/782] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:27.465311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.465830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.466311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.466741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 389/783] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:27.497323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:27.498824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:27.531692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:27.626142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 395/784] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:27.633131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7083da-d98f-4129-8061-dc86ad7c5c6a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:27.667306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:27.675551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:27.677693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.677693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.677693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.698831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:27.708552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:27.709774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:27.710814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:27.719286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 390/785] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:27.726379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:27.841101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965d164-1e81-4e88-a5a3-58328f0fdb9a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:27.878655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:27.879554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.880160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.881581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.882488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:27.883593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:27.885683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c145a0-3275-4fa5-8bfd-e288a8093031 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:27.889784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118016-be70-4845-bc59-687d860e3c5c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:27.903849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 391/786] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:27.909299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee26dd-02b7-4330-b377-435f712744f4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.909765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee26dd-02b7-4330-b377-435f712744f4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.910193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee26dd-02b7-4330-b377-435f712744f4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.915642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 392/787] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:27.916608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee26dd-02b7-4330-b377-435f712744f4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:27.933288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:27.934604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.934878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.935142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.945149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-f4a8f0f0-5b1a-494d-9d31-ba16dacbe2e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:27.953372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:27.954515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:27.955395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 396/788] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:27.956089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:27.956278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:27.956725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:27.973178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:27.974549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:28.027870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee26dd-02b7-4330-b377-435f712744f4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.043573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 397/789] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:28.044783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.078481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.079671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.080194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.080564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.091854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.093442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:28.112463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.113465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.114377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:28.114377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:28.114377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.114377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.116737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 393/790] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.122842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.160289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ecd4b-a660-4f39-8d2c-80ddbf843ba6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.198226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.199263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.199723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.200167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.201131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:28.201627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.203145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.211952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 398/791] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:28.213143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.232567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f3e4-faeb-424b-adfa-1dace270ad93 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.266010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.266930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.267278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.267621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.277810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:28.285573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.286517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.287356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 394/792] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.288045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.317292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b9561-0031-4682-914b-125a41520271 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.351382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.352704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.353206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.353706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.354612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:28.355807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.357435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.374812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 399/793] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:28.376055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.389404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887123-34e2-4330-a71f-d8f51d566ac0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.423197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.424196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.424424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.424559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.436404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.437582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:28.454975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.455927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.456849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:28.456849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:28.456849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.456849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.456849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 395/794] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.457602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.485905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a3d8-5ac4-43a5-895d-4612409c1b15 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.520448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.521478 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.521976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.522451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.523384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:28.523880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.525535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.535259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 400/795] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:28.536416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.557161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab20e5-d581-4b77-b2e6-26a251e0fe59 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.590441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.591257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.591535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.591805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.599528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.601005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:28.616376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.617367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:28.618316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.622345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 396/796] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.623295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.641492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ea9fc-b0a0-43b8-83d2-72b87be5a511 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.679572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.680695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.681189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.681659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.682579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:28.683089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.684753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.697455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 401/797] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:28.698637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.728689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c21134-93e8-488f-9807-7f66c2e6487c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.762427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.763221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.763498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.763766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.774364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.775812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:28.794940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.795976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.796888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:28.796888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:28.796888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:28.796888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.797105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 397/798] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.798177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.803144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852668-46b0-43b0-aac7-0ea5f72c61fe None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.836935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.837974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.838452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.838939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.840582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:28.841088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.842755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.860939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 402/799] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:28.861776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.900680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8fd9-8f9c-489f-b9f5-315ce2c54e2c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:28.933607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:28.934318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.934597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.934868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.942197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:28.943620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9abc0a68-c740-4269-ba78-8f5d2eaff82b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:28.957704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:28.958625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:28.959553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 398/800] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:28.960171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a656-e509-46c7-95cd-76bd156058e9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:28.960650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a656-e509-46c7-95cd-76bd156058e9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:28.960650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a656-e509-46c7-95cd-76bd156058e9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:28.963891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 399/801] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:28.963891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a656-e509-46c7-95cd-76bd156058e9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:28.966855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d729-e939-42b9-92de-9d7b46cdbe6e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.001712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.002377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.002656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.002927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.003636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:29.003934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.005325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.016887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 403/802] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:29.017674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.072768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a656-e509-46c7-95cd-76bd156058e9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.108497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.109297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.109571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.109841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.118205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db94c87-8040-4743-98fe-68babb1b33b1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.123628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.125296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c5d1df84-290b-4be1-9d22-0b1ba411481a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:29.147693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:29.148681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:29.149550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:29.149550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:29.149550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:29.149550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:29.154815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 400/803] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:29.154938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.155035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.155124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.155204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.155275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.155342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.155409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.155409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:29.155409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.155409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.168824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:29.169967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:29.172622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 404/804] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:29.173775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.249019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 401/805] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:29.250152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.283757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e2d2-41c7-44a6-bbe6-b13afc247eae None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.315729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.316573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.316856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.317130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.323818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.325293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:29.339243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:29.340785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 405/806] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:29.341772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.346579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19e66-6582-407f-b5b5-1f4f7d61efe6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.382044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.382695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.382968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.383236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.383986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:29.384327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.385724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac310b3-191d-4d59-88f7-19ff07b90930 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.396284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 402/807] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:29.397514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064f6f-c91c-4de2-9d94-5ca1b7dbfded None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.397792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064f6f-c91c-4de2-9d94-5ca1b7dbfded None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.398064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064f6f-c91c-4de2-9d94-5ca1b7dbfded None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.399256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 403/808] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:29.399932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064f6f-c91c-4de2-9d94-5ca1b7dbfded None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.438366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d6ae-15c4-4bf9-a919-a124a9843b93 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.469722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.470362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.470642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.470915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.493091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064f6f-c91c-4de2-9d94-5ca1b7dbfded None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.523806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.524571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.524851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.525124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] PATH_INFO: `/v3/services/network` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.525765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.527650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.533768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.535198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:29.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:29.540106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:29.550629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 404/809] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/services/network => generated 88 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:29.551713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.630073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 406/810] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:29.630915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.635253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af455-9ea8-4692-8353-6be776cb1080 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.667574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.668262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.668569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.668848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.669671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:29.669979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.671402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc83d6-ff23-4190-b3e7-6d34cd268ce3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.687874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 405/811] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:29.689186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.689481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.689759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.705896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:29.707079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:29.728848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a35a-c83c-4f0d-94a8-495421b8c6a3 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.759246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.760023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.760295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.760593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.767311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.768775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.768922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 406/812] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:29.769594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:29.793941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:29.795047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 407/813] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:29.795966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.864858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471bd36-33c4-4fb4-b522-45b395807090 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.885962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236246a-ded4-4c35-956d-4c3e587170b2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:29.896461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.897116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.897398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.897673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.898371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] RBAC: Adding query filter params (name=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:29.898675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.900060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.905216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 407/814] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:29.905994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:29.917848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:29.918639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:29.918919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:29.919196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:29.929586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:29.931065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:29.947412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:29.948487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 408/815] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:29.949909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.001273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818452a-c008-4dd9-9cc4-e341fad5552c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.034054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.034837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.035113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.035380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.043237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b602c20-987d-48b3-90de-209b5937b773 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.045263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.046658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:30.064606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:30.065513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:30.066421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:30.066421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:30.066421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:30.066421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:30.066421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 408/816] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:30.066710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.078412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.079223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.079508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.079784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.080470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.081827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:30.093548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:30.094713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:30.095717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 409/817] 10.222.0.21 () {56 vars in 1129 bytes} [Tue May 3 12:06:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:30.096780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.165380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af35fa-df9a-4d97-bbab-3b93572e84b6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.189614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a96c-3588-41f1-8465-17710e2777f7 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.197350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.197993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.198274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.198544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.199868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:30.200171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.201610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.212341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 409/818] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:30.213134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.221772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.222433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.222710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.222983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.223681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] RBAC: Adding query filter params (type=network) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:30.223980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.225366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.229914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 410/819] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:30.230674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.305792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a896-a7f4-49c2-a820-e0c039693cbb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.324632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee071-ed16-44af-9b6e-3f944599ee42 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.341843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.342639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.343015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.343368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.344073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:30.344426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.345881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.357263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.362155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 410/820] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:30.362316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.362316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.362316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.362595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.362669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:30.362669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.362669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.374388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 411/821] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:30.375183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.454203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdd0b-c26a-453f-b4f8-d35f0463b4ad None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.466962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0ba0-c78c-49e8-85d0-59bbe59a72d1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.490491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.491146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.491426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.491692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.492404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:30.492709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.494060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.498886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 411/822] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:30.499324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.499630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.500213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.500530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.500813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/5be2f874cbd1473fb0fe6fd0acca1acf/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.514606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=5be2f874cbd1473fb0fe6fd0acca1acf, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.516036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.593633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8101f-7500-4ed8-9044-3ad28a0aefc9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.625898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.636598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 412/823] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:30 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/5be2f874cbd1473fb0fe6fd0acca1acf/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:30.636812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.636812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.636997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.637080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.637080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.637080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.713125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 412/824] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:30.714020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.757786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849fe0f-8178-43b4-9d0a-12443c69a2f0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.816152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.817870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.818603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.819065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.829444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.831301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.832260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cc94-b0eb-4a2a-9c4e-5fa344f8bc76 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:30.850513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:30.851574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:30.852484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:30.853513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 413/825] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:30.853906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.880692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:30.881506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:30.881790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:30.882067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:30.892260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:30.894497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:30.914289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:30.915220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 413/826] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:30.916759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:30.970915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cb7-ee08-4e5d-90c8-d0a040c45915 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.005661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.006327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.006610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.006884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.007590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:31.007893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.009452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.014490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 414/827] 10.222.0.21 () {56 vars in 1124 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:31.019791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:31.028649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394342b-9693-420e-8d6a-22fc201d78d6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.062193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.063117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.063392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.063728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.064541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:31.064851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.066280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.077795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 414/828] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:31.078694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:31.121158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51c4-cde1-4940-8c36-f63ee707a468 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.153743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.154404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.154686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.154960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.155740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:31.156053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.157513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.173603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 415/829] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:31.173603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:31.184752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c2001-6a4b-4ff0-aa17-54fb6593c738 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.217218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.217865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.218146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.218420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.219145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.220529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.263458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2254aa-643a-43d4-a285-1cefd8a6d2e4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.304317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 415/830] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:31.304317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:31.312642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.313418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.313771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.314167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.315124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:31.315512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.317639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f600d3-549c-4fd4-97e5-89e135ce0b90 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.332407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 416/831] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:31 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:31.451832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4a9e-0653-45b5-a615-706d84f4dcf5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:31.491727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:31.492845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:31.493226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:31.493634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/cb8f96204ad44d3888970d5335afad3e/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:31.495983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=cb8f96204ad44d3888970d5335afad3e, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:31.497623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ddc2d-b0f2-4649-ab5d-493fa4051dcb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:31.564120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 416/832] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:31 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/cb8f96204ad44d3888970d5335afad3e/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:06:32.935706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a939f-7be6-423f-8a07-7582e24b3ca9 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:32.936269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a939f-7be6-423f-8a07-7582e24b3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:32.936269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a939f-7be6-423f-8a07-7582e24b3ca9 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:32.938094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 417/833] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:32.943357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:32.943780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:32.943957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:32.960744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:32.961918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:33.032689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 417/834] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:33.052958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a939f-7be6-423f-8a07-7582e24b3ca9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.152677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a939f-7be6-423f-8a07-7582e24b3ca9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.186698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.187424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.187700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.187969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.203866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:33.211550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:33.212515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:33.214319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 418/835] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:33.218840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.315608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1ba4-6ecd-407e-bf8e-96296b969a4b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.351948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.352927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.353416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.353892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.354840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:33.355417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:33.357079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:33.366700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 418/836] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:33.372590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.474344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf727-51c2-4554-a727-d6b7e66ce033 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.509645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.510438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.510712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.510983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.521732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:33.523162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c95dd893-ba7d-4947-ab38-fb0320f0da32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:33.540332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:33.541355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:33.542258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:33.542258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:33.542258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:33.542258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:33.542258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 419/837] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:33.548273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.649169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa53c-d4ff-4dfe-a83a-25350c458c7b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.652565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab07-8fd4-432a-a9a3-93a18795958f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.652851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab07-8fd4-432a-a9a3-93a18795958f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.653126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eab07-8fd4-432a-a9a3-93a18795958f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.654728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 420/838] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:33.663017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a27-08a0-49f0-a21a-6a7c986d356a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.663304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a27-08a0-49f0-a21a-6a7c986d356a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.663581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a27-08a0-49f0-a21a-6a7c986d356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.681723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d3876a27-08a0-49f0-a21a-6a7c986d356a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:33.682936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3876a27-08a0-49f0-a21a-6a7c986d356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:33.689811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.690493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.690769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.691037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.692453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:33.692760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:33.694645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:33.712300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 419/839] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:33.718202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.756158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 421/840] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:33.757827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf49b0-b9a2-476d-acaa-7d8c36cc7a78 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.758185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf49b0-b9a2-476d-acaa-7d8c36cc7a78 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.758533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf49b0-b9a2-476d-acaa-7d8c36cc7a78 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.760011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 422/841] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:33.764814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.765100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.765379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.782615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:33.783812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:33.833852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442f55-915c-42a5-af95-d323ce4d3af9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.847525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 423/842] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:33.848161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.877934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.878736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.879009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.879274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.886465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:33.887884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:33.902677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:33.903636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 420/843] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:33.905016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:33.947857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb472f32-13ad-4d8d-92fa-4d845b44516f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:33.979138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:33.980539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:33.980822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:33.981088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:33.981730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:33.983075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2426c0d0-e292-41a5-9437-c2bdf67b2de4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:33.994336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:33.995362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:33.996238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:33.997198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3ab8-c4b2-4854-bb43-4cc3c2cfa339 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.000444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 424/844] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:34.001721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952144-3006-4e48-9803-7091e40acf19 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.002003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952144-3006-4e48-9803-7091e40acf19 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.002276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99952144-3006-4e48-9803-7091e40acf19 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.003536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 425/845] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:34.004210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99952144-3006-4e48-9803-7091e40acf19 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.028932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.029670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.029953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.030221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.030861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.032216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:34.044829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:34.045776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:34.046593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 421/846] 10.222.0.21 () {56 vars in 1132 bytes} [Tue May 3 12:06:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:34.047416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.098211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99952144-3006-4e48-9803-7091e40acf19 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.130513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.131211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.131491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.131761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.132638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.132941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.134360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a4eb-eb47-4b22-88d2-a30a46922e0e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.147154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c04e-d405-4b81-b14b-ae750f2560e9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.151069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 426/847] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.152281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.152588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.152858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.168154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:34.169337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:34.179501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.180149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.180455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.180725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.181410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.181717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.183594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.187813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 422/848] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.188590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.232626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 427/849] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:34.233449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.284151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd659df-81f0-4991-80d2-15fa79bbaebd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.315971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.316642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.316924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.317197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.317885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.318185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.319540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.323844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 423/850] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.324627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.324836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e129-9838-4eb7-9505-f18c752a40ec None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.357143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.357788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.358066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.358335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.419541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f1bd-4a2b-45fc-9db7-f682906c47ed None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.423284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.424760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.450712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.451354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.451631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.451903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.452632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.452926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.454262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.458406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 424/851] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.459161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.523712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 428/852] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:34.525150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.563659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f5a9-eaf5-4d2d-bb1d-1b00df2496d2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.597354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.598177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.598459 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.598726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.610338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:34.618371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:34.619353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 425/853] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:34.625804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.627661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ace26-8b92-4745-a876-ce579eb7ed5c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.669316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.670508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.670640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.671001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.671711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.672015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.673478 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.688679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 429/854] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.688679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.744860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50efdb-0cc3-4160-8a20-114eb6c7afc1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.780534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.781496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.781876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.782247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.787030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da24e-e216-44bd-96b3-30544b053067 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.794515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.796127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:34.815537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:34.816616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:34.817504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:34.817504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:34.817504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:34.817504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:34.818010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 426/855] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:34.823099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.825048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.825770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.826059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.826332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.827096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.827401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.828877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.843348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 430/856] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:34.844431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.932507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cdafa-596b-4336-8978-f08bba37f2a4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.953269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c434d1-d4df-48ae-832e-9d1fb488b00e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:34.972932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.973594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.973875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.974148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.974861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:34.975166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:34.976553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:34.986662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:34.987467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:34.987747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:34.988017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:34.990473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 427/857] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:34.995812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:34.999415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.000901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:35.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:35.019474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:35.020383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:35.020383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:35.020383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:35.020383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:35.020383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 431/858] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:35.029504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.093752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78060-3ccc-4fb2-a912-164e5e4c5594 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.126618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.127409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.127684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.127953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.132018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524446d-774a-45c9-ae74-895c5d284a74 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.134763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.136750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:35.150553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:35.153174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:35.155268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:35.164408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 428/859] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:35.164408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.170817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.171736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.172337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.172837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.173743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:35.174639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.176855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.193373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 432/860] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:35.199848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.271559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1584-c410-4f31-9748-e8d97eac5469 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.309568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.310240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.310521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.310795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.311582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:35.311891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.313363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.327395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 429/861] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:35.343033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5a53-523f-4f83-b03c-2c0e42ea6fa8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.343175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.370137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.371679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.372122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.372581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.381844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.386673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:35.403050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:35.404183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 12:06:35.405207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:35.405754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 433/862] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:35.411178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.439627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ef0a-4aaa-4599-89ef-573135897309 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.474987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.475640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.475967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.476275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.477141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=5be2f874cbd1473fb0fe6fd0acca1acf) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:35.477452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.478874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.492390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 430/863] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/role_assignments?user.id=5be2f874cbd1473fb0fe6fd0acca1acf&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:35.519706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caed46-3738-45d2-9bf0-ca5fa7d12b83 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.558802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.559484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.559763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.560037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.560922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:35.561228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.562664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.583238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 434/864] 10.222.0.21 () {56 vars in 1135 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:35.589592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:35.698830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964d-37a6-44ab-9f95-351e3452d518 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:35.731584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:35.732233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:35.732541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:35.732811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:35.799251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:35.800739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:35.897012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 431/865] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:35.903237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.001919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ead7-8dad-4967-a0ce-2d3403743529 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:36.035559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:36.036693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.037210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.037691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.048392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:36.050084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:36.067460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:36.068355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:36.069267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:36.069267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:36.069267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:36.069267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:36.071414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 435/866] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:36.077154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.172751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08bc65-e484-43fa-9de8-4e573cd2b770 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:36.206575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:36.207595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.208073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.208563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.209478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:36.209994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:36.211553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:36.223963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 432/867] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:36.229585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.327443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da745c7-9ed4-49c0-a3fe-4754eff469af None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:36.363652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:36.363652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.364750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.364990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.371806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:36.373261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:36.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:36.388262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:36.389199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 436/868] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:36.394620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.492252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d1a2-c5d3-4e45-ac7e-87bb67b486a2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:36.524509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:36.525169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.525500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.525771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.526605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:36.527517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:36.528968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0a2c0-7cd5-4695-8382-4509f96856c7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:36.546462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 433/869] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:36.552932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.656732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bd6-30ac-4d15-a86b-9d7b806e672d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:36.689387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:36.690041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.690368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.690638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.691455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=cb8f96204ad44d3888970d5335afad3e) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:36.691810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:36.693251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fb81e-ef34-41cc-87bd-878ffb61a306 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:36.699967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 437/870] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:36 2022] GET /identity/v3/role_assignments?user.id=cb8f96204ad44d3888970d5335afad3e&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:36.741971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70008ab2-a53d-4db4-8e1d-8ee49f732a93 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.742290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70008ab2-a53d-4db4-8e1d-8ee49f732a93 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.742515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70008ab2-a53d-4db4-8e1d-8ee49f732a93 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.743915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 434/871] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:36.749712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e7de-f649-4426-b207-b4f402fd4365 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:36.750008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e7de-f649-4426-b207-b4f402fd4365 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:36.750256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e7de-f649-4426-b207-b4f402fd4365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:36.768661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5807e7de-f649-4426-b207-b4f402fd4365 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:36.769888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5807e7de-f649-4426-b207-b4f402fd4365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:36.844947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 438/872] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:36.867652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70008ab2-a53d-4db4-8e1d-8ee49f732a93 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:36.974337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70008ab2-a53d-4db4-8e1d-8ee49f732a93 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:37.007889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:37.008613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.008892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.009163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.009887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:37.011854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a9bb-e657-4d59-a1cc-51919d7e5c5e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:37.101861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 435/873] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:36 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:37.108323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0705-5764-47d1-a2da-8bbd00185efb None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.108952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0705-5764-47d1-a2da-8bbd00185efb None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.108952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0705-5764-47d1-a2da-8bbd00185efb None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.110907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 439/874] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:37.118743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5232cb-3fd0-4305-9226-47d6d3c37956 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.118743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5232cb-3fd0-4305-9226-47d6d3c37956 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.118743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5232cb-3fd0-4305-9226-47d6d3c37956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.137143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5b5232cb-3fd0-4305-9226-47d6d3c37956 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:37.138774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5b5232cb-3fd0-4305-9226-47d6d3c37956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:37.216098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 436/875] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:37.238941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0705-5764-47d1-a2da-8bbd00185efb None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:37.357756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0705-5764-47d1-a2da-8bbd00185efb None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:37.394762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:37.395796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.396270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.396780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.397747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:37.399345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ead432-2421-47b7-ad29-9a2da4967bfc None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:37.496798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 440/876] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:37 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:37.974023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0c10-77cb-4762-a141-186c6f50e00a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.974404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0c10-77cb-4762-a141-186c6f50e00a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.974581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0c10-77cb-4762-a141-186c6f50e00a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.976174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 437/877] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:37.981745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785770-97de-4772-a927-c3257f64e037 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:37.982033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785770-97de-4772-a927-c3257f64e037 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:37.982306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785770-97de-4772-a927-c3257f64e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:37.999428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-30785770-97de-4772-a927-c3257f64e037 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:38.000926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-30785770-97de-4772-a927-c3257f64e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:38.072012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 441/878] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:38.094576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0c10-77cb-4762-a141-186c6f50e00a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:38.194546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0c10-77cb-4762-a141-186c6f50e00a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:38.227524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:38.228265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:38.228550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:38.228815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:38.240544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:38.249349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:38.250274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:38.251092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 438/879] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:38.256745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30785770-97de-4772-a927-c3257f64e037 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:38.356619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30785770-97de-4772-a927-c3257f64e037 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:38.390290 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:38.390959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:38.391237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:38.391506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:38.392250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:38.392578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:38.393937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:38.403021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 442/880] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:38.408612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:38.507047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4814f-8943-4eea-9385-8d44b736b261 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:38.539937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:38.540762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:38.541037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:38.541309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:38.555525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:38.558337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:38.576234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:38.578243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:38.580339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:38.580339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:38.580339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:38.580339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:38.580339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 439/881] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:38.583397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:38.682811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5204-d113-4765-88ca-047f557872b2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:38.718402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:38.719069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:38.719337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:38.719608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:38.720324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:38.720652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:38.722003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:38.734168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 443/882] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:38.739597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:38.839848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2498c-b28a-48d1-b8ec-41bc3ca2d59f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:38.876393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:38.877277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:38.877549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:38.877813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:38.885575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:38.887658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5ba6f301-3773-42c7-8fdb-7cd8ec68ddb5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:38.902857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:38.904984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:38.907131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 440/883] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:38.912405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.009678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279a565-4f5e-44ca-a799-f99daff80c22 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.029647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb47e-0872-4cde-80c0-28d195e3dcc5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.030157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb47e-0872-4cde-80c0-28d195e3dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.030661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb47e-0872-4cde-80c0-28d195e3dcc5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.033012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 441/884] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:39.041634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.042476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.043202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.049492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.050858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.050858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.050858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.051784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:39.052090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.053553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.065258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:39.066713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:39.071442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 444/885] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:39.078407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.156575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 442/886] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:39.173221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.186337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446ee5-c0cc-48cf-9bdf-f8cf7efd38b6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.231901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.233114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.233748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.234200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.270974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b03c48-eeab-427b-bcb2-779cd582b6a6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.314482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.315434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.315793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.316135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.316926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.318408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.329191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.331354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:39.332553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:39.333535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:39.334395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.339170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 443/887] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:39.340617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.442573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d27a-78e7-4a84-a1c8-6cddc147309b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.447773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 445/888] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:39.448893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.476817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.477629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.478022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.478385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.479304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:39.480110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.481836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.491537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 444/889] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:39.492911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.547668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb997d-3292-4fe7-923b-846ac0b02661 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.581428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.582216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.582497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.582771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.591077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20adc-3db1-4c45-9766-93e6b4bcceb1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.592349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.593820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-efeae46a-1996-4b99-87ee-0521e3c54c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:39.613698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:39.614614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:39.615492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:39.615492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:39.615492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:39.615492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:39.619881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 446/890] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:39.621586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0266-7f2f-4f79-94c1-ee161bb38a22 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.621869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0266-7f2f-4f79-94c1-ee161bb38a22 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.622143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0266-7f2f-4f79-94c1-ee161bb38a22 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.623662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 447/891] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:39.624374 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0266-7f2f-4f79-94c1-ee161bb38a22 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.629542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.630484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.630978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.631255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.631963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:39.632266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.633667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a80c3-9f48-45a5-bdd8-9633320c51b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.648572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 445/892] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:39.648572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.648572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.648572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.665605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:39.667552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:39.745230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 446/893] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:39.770377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.774784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0266-7f2f-4f79-94c1-ee161bb38a22 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.820969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.821976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.822415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.824298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.824298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:39.824298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.826869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b020b8f-46c5-4205-8e45-7ef2ee9cff9d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.843279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 448/894] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:39.847211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326fd8-99c3-4341-a7ee-cbe40d086b61 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.847211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326fd8-99c3-4341-a7ee-cbe40d086b61 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.847211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326fd8-99c3-4341-a7ee-cbe40d086b61 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.847211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 449/895] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:39.849175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326fd8-99c3-4341-a7ee-cbe40d086b61 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:39.884576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6760fd-623c-4e00-8e84-fed6b26c188d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.924001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.924895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.925173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.925439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.926332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.927686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8cb7dc7a-aa75-43e6-9c0c-c784b8a0f56d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:39.939291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:39.940491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:39.941330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 447/896] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:39.942120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.942364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.942644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.955011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326fd8-99c3-4341-a7ee-cbe40d086b61 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:39.958472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:39.959638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:39.988320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:39.989416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:39.989793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:39.990069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:39.996681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:39.998123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:40.011940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:40.012938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 450/897] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:40.014345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.028676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 448/898] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:40.028676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.112747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840cf99-27f4-4984-b0d4-036f61cb5d99 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.128403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c07f6-6060-4ebf-bc2a-9f9351c3469d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.144282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.144965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.145241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.145511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.146209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.146508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.147856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.153119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 451/899] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.153939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.166579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.167262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.167537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.167809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.168604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.168907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.170348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.186249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 449/900] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.186249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.253217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b2b28-c43a-42f9-8466-1fed241dc62d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.281492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f18f8-a90d-48fe-9c7b-51ed6146e1fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.285403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.286223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.286498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.286876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.287520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.288906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:40.300664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:40.302039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:40.302876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 452/901] 10.222.0.21 () {56 vars in 1132 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:40.303885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.322145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.322798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.323092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.323869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.324590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.324886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.326229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.333978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 450/902] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.333978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.409145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe53d-bdf2-48f3-b4c4-a2f917f24399 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.439664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fddc-2069-4411-8050-f6b2d28b27c3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.441480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.442139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.442418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.442694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.443519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] RBAC: Adding query filter params (role.id=a921a2f9b3d242519885c2dcc0c1ba9a, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=5be2f874cbd1473fb0fe6fd0acca1acf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.443825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.445267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.451261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 453/903] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/role_assignments?user.id=5be2f874cbd1473fb0fe6fd0acca1acf&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=a921a2f9b3d242519885c2dcc0c1ba9a => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.452047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.484198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.485094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.485438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.485782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.486613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.487005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.488605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.494378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 451/904] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.499956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.578068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d228-a6fd-460f-aa6c-a771d6613799 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.613087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.613753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.614033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.614308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.615193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] RBAC: Adding query filter params (interface=public, service_id=9f28dea76abd4fb0857d8b739c283ed8, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.615471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.616960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.623167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 454/905] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/endpoints?service_id=9f28dea76abd4fb0857d8b739c283ed8&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:40.628937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.629786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d05-f528-4ba1-834e-3ff53bc39713 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.677382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.678095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.678378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.678656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.679937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.680250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.681875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.692410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 452/906] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:40.694539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.742255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65453987-1e04-4fe7-8847-977be66aa2a1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.777776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.778442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.778724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.779003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.779689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.781103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.796473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 455/907] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:06:40.820897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d14ec-2ee5-465f-a237-b492cefb106a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:40.858582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:40.859245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:40.859528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:40.859851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:40.860686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] RBAC: Adding query filter params (interface=public, service_id=276188e662624ee19d875863ca33817e, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:40.860998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:40.862382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0208dd-009b-4bf1-93e5-493b727fdfe6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:40.871536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 453/908] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/endpoints?service_id=276188e662624ee19d875863ca33817e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:40.877176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:40.980516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ec19-f326-4efe-a5e4-913bfb52f435 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:41.016845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:41.017511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:41.017791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:41.018066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:41.018742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:41.020096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b613-c702-4784-a359-67d29c7cbdc0 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:41.025885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 456/909] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:40 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:06:41.937527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc69c-1874-4bee-8c2e-8d682dfca7d5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:41.938151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc69c-1874-4bee-8c2e-8d682dfca7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:41.938151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc69c-1874-4bee-8c2e-8d682dfca7d5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:41.939558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 454/910] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:41.945024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea7b1-f975-40c3-8727-76d1d4728666 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:41.945828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea7b1-f975-40c3-8727-76d1d4728666 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:41.946321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea7b1-f975-40c3-8727-76d1d4728666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:41.964806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-545ea7b1-f975-40c3-8727-76d1d4728666 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:41.966271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-545ea7b1-f975-40c3-8727-76d1d4728666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:42.033898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 457/911] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:42.056795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcc69c-1874-4bee-8c2e-8d682dfca7d5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:42.159668 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcc69c-1874-4bee-8c2e-8d682dfca7d5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:42.195450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:42.196488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:42.196969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:42.197441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:42.198941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:42.200525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdfdc1-4a63-4913-b869-e8ac4120885d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:42.284395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 455/912] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:42 2022] POST /identity/v3/services => generated 241 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:42.718186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eec0-078a-49d6-bec5-edb66a140c23 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:42.718597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eec0-078a-49d6-bec5-edb66a140c23 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:42.718786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eec0-078a-49d6-bec5-edb66a140c23 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:42.720239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 458/913] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:42.725699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:42.726207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:42.726701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:42.743796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:42.745975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:42.816126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 456/914] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:42.838244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eec0-078a-49d6-bec5-edb66a140c23 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:42.942325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eec0-078a-49d6-bec5-edb66a140c23 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:42.975979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:42.976742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:42.977021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:42.977297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:42.988171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:42.996913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:42.997905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:42.998742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 459/915] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:06:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:43.006370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.119180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7648-ec18-4fdb-9500-f92aa606f136 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.156891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.157961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.158437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.158905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.159848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:43.160344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.162364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4444-641e-441a-8312-b3a8b1a632a7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.171240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 457/916] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:43.177250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.204524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccf06-2bcf-4229-988e-711972f10538 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.204871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccf06-2bcf-4229-988e-711972f10538 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.205093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccf06-2bcf-4229-988e-711972f10538 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.207232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 458/917] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:43.213221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a7d1-70dc-4158-9f1f-bf7e91feacb7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.213658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a7d1-70dc-4158-9f1f-bf7e91feacb7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.214515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a7d1-70dc-4158-9f1f-bf7e91feacb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.234362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a272a7d1-70dc-4158-9f1f-bf7e91feacb7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:43.235920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a272a7d1-70dc-4158-9f1f-bf7e91feacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:43.289563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d9a7-bdc9-4c5e-b017-1298e35de960 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.315175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 459/918] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:43.316910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacdf1-aab0-4635-b832-8ecd08eba46e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.317192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacdf1-aab0-4635-b832-8ecd08eba46e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.317462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfacdf1-aab0-4635-b832-8ecd08eba46e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.318828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 460/919] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:43.324512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.331886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.331886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.342406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:43.343573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:43.349581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.350479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.350722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.350997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.365279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.367202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:43.389508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:43.390455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:43.391366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:43.391366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:43.391366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:43.391366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.391366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 460/920] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:43.391648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.415965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 461/921] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:43.417289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.502859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183226-24b2-4688-b0f6-20972b1576c6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.525186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e1495-6295-47fc-977b-558d1541278e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.535425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.536224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.536554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.536816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.537468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.538827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:43.550820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:43.552053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.553235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 461/922] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:43.554067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.564407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.565071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.565358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.565634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.566349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:43.566654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.568014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.579372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 462/923] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:43.580198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.660120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdbea-b83f-448c-a357-713ffdeb6918 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.675255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c3e5-2d6d-4db9-a2f5-ac84a43094f1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.693671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.694743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.695238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.695692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.696560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.698113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.709440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.710098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.710380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.710653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.711347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:43.711651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:43.712727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:43.713876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 12:06:43.714843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.715808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.717470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 462/924] 10.222.0.21 () {56 vars in 1132 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:43.718384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.722465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 463/925] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:43.723364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.816449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910d23-ecb0-4a7a-8459-e14b78d8c14e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.819431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65679-c8b4-4b9b-9e8e-8121e229b2b9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.851110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.851922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.852200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.852500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.852950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.853797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:43.854257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:43.854702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:43.855546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:43.856014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.857552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.861078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:43.862421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 464/926] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:43.862818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:43.863203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:43.882006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:43.883163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:43.884309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:43.888593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 463/927] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:43.889332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:43.965805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b87f93-4657-472f-91fb-9bfdfcc7ded4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.986831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385676a-0bfb-4c3d-af87-9cd189d95e37 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:43.999294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:43.999956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.000239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.000550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.001348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:44.001546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.002916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.007713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 465/928] 10.222.0.21 () {56 vars in 1114 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:44.008464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.022074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.022943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.023390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.023817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.024555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:44.024860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.026241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.035585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 464/929] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:44.035585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.107998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965093-4120-4d79-9612-693c0f8d74ec None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.132151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7a28-915e-4991-a527-d17a35e3d31a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.143979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718536-8107-4592-8506-53c386830763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.144857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718536-8107-4592-8506-53c386830763 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.145146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718536-8107-4592-8506-53c386830763 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.145424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08718536-8107-4592-8506-53c386830763 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.146251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718536-8107-4592-8506-53c386830763 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:44.146560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718536-8107-4592-8506-53c386830763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.147977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08718536-8107-4592-8506-53c386830763 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.164264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.169715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 466/930] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:44.169851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.169851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.169851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.170077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718536-8107-4592-8506-53c386830763 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.170178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.170178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.260895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 465/931] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:44.262137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.277781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08718536-8107-4592-8506-53c386830763 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.344048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.345432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.345902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.347009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.348231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.349935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c14fb4-042e-4bf0-8a8a-4414821aefe1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.385665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b7f35-a032-47f2-bc88-63b8f002227a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.425264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.426445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.426726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.427001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.438861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.440352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:44.460011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:44.461012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:44.461930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:44.461930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:44.461930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:44.461930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:44.468836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 466/932] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:44.469573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 467/933] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:44.470738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.580215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646455-81f3-48ea-ab58-124c2bf9cdd1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.590536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e23d-ae0b-4c43-b77a-04d7212aebfd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.590815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e23d-ae0b-4c43-b77a-04d7212aebfd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.591089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24e23d-ae0b-4c43-b77a-04d7212aebfd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.592835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 468/934] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:44.602767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.602767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.603067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.622163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:44.623401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:44.625157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.626042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.626326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.626608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.627344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:44.627676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.629070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.643028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 467/935] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:44.648116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.709709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 469/936] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:44.732866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.756321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04069-c2cf-4e6a-8f5c-8f07b2861a59 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.792559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.793352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.793628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.793900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.800831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.802750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:44.816878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:44.817802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:44.818681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 468/937] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:44.824451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.842620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd16bbc-26bf-4578-ba25-b36840a77bd8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.876471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.877639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.878125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.878598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.879468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.881059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:44.894014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:44.895006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:44.895847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:44.904066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 470/938] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:44.905200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:44.924610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a675-8c85-4670-977c-720b91f24297 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:44.958421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:44.959090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:44.959375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:44.959630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:44.960435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:44.960749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:44.962400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:44.975203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 469/939] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:44.980997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:45.006478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe511-522c-4c51-99dc-238490ec3a33 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:45.040692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:45.042160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:45.042666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:45.043155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:45.044070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:45.044603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:45.046173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:45.056266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 471/940] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:45.057955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:45.078981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ecd1-e787-406c-8eab-821bb83fc9b5 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:45.112275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:45.113195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:45.113476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:45.113782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/5be2f874cbd1473fb0fe6fd0acca1acf/roles/a921a2f9b3d242519885c2dcc0c1ba9a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:45.116209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=5be2f874cbd1473fb0fe6fd0acca1acf, role_id=a921a2f9b3d242519885c2dcc0c1ba9a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:45.117661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:45.157822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0dacc-20c5-439e-a524-27cdfdf284c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:45.190306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:45.190975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:45.191275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:45.191532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:45.192235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:45.192568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:45.193944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:45.204801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 470/941] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:06:44 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/5be2f874cbd1473fb0fe6fd0acca1acf/roles/a921a2f9b3d242519885c2dcc0c1ba9a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:06:45.207930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 472/942] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:45.208044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:45.327358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1857-037a-4277-97d1-1ea9fef91c6c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:45.366656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:45.367343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:45.367626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:45.367901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:45.368738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] RBAC: Adding query filter params (interface=public, service_id=7d8b5b2883374e4c985086e3441a370f, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:45.369047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:45.371006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58ac15-ff6f-4ff8-8c5a-90b124aa1074 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:45.377331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 471/943] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:45 2022] GET /identity/v3/endpoints?service_id=7d8b5b2883374e4c985086e3441a370f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:45.382955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:45.486167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901058-53e8-41a1-aab4-02667eaeede4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:45.519080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:45.519769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:45.520052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:45.520330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:45.521057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:45.522478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc072ae-d634-4c6f-b0cd-a4aaf3df26ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:45.529596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 473/944] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:45 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:06:46.672616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000090ab-c6a9-4f0d-a69e-5ad6311620fa None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:46.673157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000090ab-c6a9-4f0d-a69e-5ad6311620fa None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:46.673157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000090ab-c6a9-4f0d-a69e-5ad6311620fa None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:46.674749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 472/945] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:46.680887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60abd-105b-4cef-b298-75a905490843 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:46.681393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60abd-105b-4cef-b298-75a905490843 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:46.681474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60abd-105b-4cef-b298-75a905490843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:46.699655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d1f60abd-105b-4cef-b298-75a905490843 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:46.700852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1f60abd-105b-4cef-b298-75a905490843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:46.768354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 474/946] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:46.791439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000090ab-c6a9-4f0d-a69e-5ad6311620fa None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:46.848269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d87-0d4f-443d-904c-c9f78cb24d6d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:46.848641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d87-0d4f-443d-904c-c9f78cb24d6d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:46.848838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d87-0d4f-443d-904c-c9f78cb24d6d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:46.850612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 475/947] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:46.861221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:46.861674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:46.862045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:46.883174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:46.884528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:46.898594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000090ab-c6a9-4f0d-a69e-5ad6311620fa None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:46.933181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:46.934193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:46.934695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:46.935203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:46.936127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:46.937799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:46.939385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING keystone.server.flask.common [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 12:06:46.962945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 476/948] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:46.985409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.003093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.sql.core [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 12:06:47.003093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 12:06:47.003093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [parameters: {'id': 'a672e4c9823a46c8aed790f8d12298d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 12:06:47.003093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a672e4c9823a46c8aed790f8d12298d1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a672e4c9823a46c8aed790f8d12298d1. May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application conn.query(q) May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:06:47.024901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result.read() May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 12:06:47.025845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application next(self.gen) May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application yield resource May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application next(self.gen) May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.session.rollback() May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.force_reraise() May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise self.value May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application session.commit() May 03 12:06:47.026827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._prepare_impl() May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.session.flush() May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._flush(objects) May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application compat.raise_( May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application flush_context.execute() May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 12:06:47.027752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rec.execute(self) May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 12:06:47.028727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application conn.query(q) May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result.read() May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:06:47.029548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [parameters: {'id': 'a672e4c9823a46c8aed790f8d12298d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.032665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:47.034645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a672e4c9823a46c8aed790f8d12298d1. May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.037641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 473/949] 10.222.0.21 () {60 vars in 1140 bytes} [Tue May 3 12:06:46 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:47.039251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.113029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61f38-b0ed-4099-96de-8151b16efefe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.144616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f4bc-bfba-499d-bd18-d999d2f48ab9 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.152191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.153008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.153282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.153548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.154188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.155604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:47.168151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:47.169262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:47.170156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:47.174270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 477/950] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:47.175214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.190777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.192571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.193065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.193711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.202808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.205510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:47.222335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:47.223256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:47.224152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.228533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 474/951] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:47.230001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.296545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e651cd-ce91-4628-9bcb-c6cd602f13aa None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.328307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e181-e2a7-4355-b54c-263aff82a9c8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.346836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.347471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.347869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.348173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.349039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:47.349419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.351879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:47.360406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 478/952] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:47.367829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.386042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.386813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.387064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.387333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.388087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:47.388436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.389985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dadcb-2f22-4ef3-bab4-3b266cca8e63 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:47.416524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 475/953] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:47.485464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae6d8-ac4b-46b1-9010-3c02ab826fea None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.522324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.523400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.523924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.524437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.525362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:47.525888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.528052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c708d6-174d-437e-9bfc-278dd80221e8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:47.540535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 479/954] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:47.550291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8b97-52e4-4792-8489-4a2d5f6ea6cc None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.550626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8b97-52e4-4792-8489-4a2d5f6ea6cc None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.551111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8b97-52e4-4792-8489-4a2d5f6ea6cc None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.552990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 476/955] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:47.558856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990d48f-bd52-4f24-be4a-a51e24f083b5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.559202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990d48f-bd52-4f24-be4a-a51e24f083b5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.559431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990d48f-bd52-4f24-be4a-a51e24f083b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.577883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8990d48f-bd52-4f24-be4a-a51e24f083b5 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:47.579134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8990d48f-bd52-4f24-be4a-a51e24f083b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:47.659612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 480/956] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:47.685037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8b97-52e4-4792-8489-4a2d5f6ea6cc None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.790321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8b97-52e4-4792-8489-4a2d5f6ea6cc None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.824412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.825283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.825558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.825826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.835100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388329-d598-4d1b-9ab5-c63f73a64b62 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.835604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388329-d598-4d1b-9ab5-c63f73a64b62 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.835690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388329-d598-4d1b-9ab5-c63f73a64b62 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.837289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 481/957] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:47.838153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:47.842850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.843140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.843466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:47.847888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:47.848891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:47.849768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:47.852097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 477/958] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:47.858102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.860304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:47.861540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:47.929487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 482/959] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:47.952272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:47.959711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfb8c-22e9-49b6-8343-365250c6a43d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:47.993412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:47.994312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:47.994804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:47.995233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:47.996117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:47.996600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:47.998119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.006992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 478/960] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:48.013127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.051098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204e4d-623c-4a38-86ef-4ce42a0be589 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.095518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.096573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.097030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.097442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.098227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.100148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:48.115857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:48.117088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:48.118114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:48.121585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 483/961] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:48.126917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.130669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0476772-1ccc-4b3e-b53b-2d7d1f1f8518 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.164122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.165039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.165387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.165729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.178879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.180973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:48.203383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:48.204534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:48.205644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:48.205644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:48.205644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:48.205644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:48.211119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 479/962] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:48.212352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.245435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552dba4-c066-4f4b-a5af-f1ec0ff16c96 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.282296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.283524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.284389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.285161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.286230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:48.287046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.289102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.296055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 484/963] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:48.302912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.341244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b87b8-98ed-4129-9409-72c3040dfbe9 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.376386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.377200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.377493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.377846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.378641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:48.379018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.380498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.398271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 480/964] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:48.399767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.424140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f061d-9ce3-4066-a891-b9c6282b706f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.459049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.459789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.460044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.460322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.461065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:48.461368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.462940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.472761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 485/965] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:48.473604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.522394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192c63-b5da-4908-88cf-3a99be71855c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.569061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.569878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.570157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.570428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.579936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.581435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.582388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0bcc-d251-4c95-a499-c29fd7efb261 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:48.596574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:48.597575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:48.598544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 481/966] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:48.605117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.626416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.627050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.627331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.627603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.628423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.629991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.709457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 486/967] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:48.723323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4380b3-aaf4-4ca7-a091-fe3ed5f1f202 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.768874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.770010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.770581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.771105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:48.772232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:48.772785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:48.774553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:48.795551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 482/968] 10.222.0.21 () {56 vars in 1149 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:48.801927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:48.908924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214dd23-1b11-4a7d-b798-09d213050338 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:48.941836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:48.942483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:48.942775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:48.943045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.008296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.009767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.108509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 487/969] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:06:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:06:49.113838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.211597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd55c-8370-48c1-8319-882d55c9b853 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:49.244844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:49.245701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.245980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.246317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.256262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.257726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:49.275360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:49.276924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:49.277980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:49.277980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:49.277980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:49.277980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:49.277980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 483/970] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:49.283076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.386500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5b74e-3754-4082-b359-9ef9563bde18 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:49.426290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:49.426951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.427226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.427493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.428238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:49.428569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.430013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.441804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 488/971] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:49.446992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.545763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993631-36d6-47c3-8480-91f9748f3060 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:49.580791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:49.581962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.582466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.582964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.590158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.591860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:06:49.605945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:49.606896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:06:49.607904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:49.610409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 484/972] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:49.615908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.725587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d14c-21f0-4e5b-9b27-4b6dcc870718 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:49.759564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:49.760297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.761120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.761392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.762161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:49.762463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.763875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64354-0bcb-4834-b97c-e03a2e11acb4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.776301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 489/973] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:49.781885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.827104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aae8-7d76-4bb0-a426-2c68b88a89e3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.827663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aae8-7d76-4bb0-a426-2c68b88a89e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.827937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aae8-7d76-4bb0-a426-2c68b88a89e3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.829472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 490/974] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:49.834351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bef74-94ad-4e3a-aa8d-af7c44ffcb4e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.834639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bef74-94ad-4e3a-aa8d-af7c44ffcb4e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.834912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bef74-94ad-4e3a-aa8d-af7c44ffcb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.851967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c43bef74-94ad-4e3a-aa8d-af7c44ffcb4e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:49.853174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c43bef74-94ad-4e3a-aa8d-af7c44ffcb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:49.884395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151825d-a24f-4264-82ba-a36451435e1e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:49.917335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:49.917985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.918264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.918532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.919350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] RBAC: Adding query filter params (role.id=a921a2f9b3d242519885c2dcc0c1ba9a, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=5be2f874cbd1473fb0fe6fd0acca1acf) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:49.919658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:49.927907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 491/975] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:49.928581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:49.928691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cc593-0114-47e4-aec2-494655bc1b9e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.928691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cc593-0114-47e4-aec2-494655bc1b9e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.928691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cc593-0114-47e4-aec2-494655bc1b9e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.928691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 492/976] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:49.929112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:49.929395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:49.930606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:49.934972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 485/977] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:06:49 2022] GET /identity/v3/role_assignments?user.id=5be2f874cbd1473fb0fe6fd0acca1acf&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=a921a2f9b3d242519885c2dcc0c1ba9a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:49.947893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:49.963518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:49.965134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:50.052963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 493/978] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:50.069552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddba35-8eb1-466e-9386-7ecf8ceba440 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:50.076345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:50.108106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:50.109810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:50.110501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:50.111175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:50.112602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:50.114359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:50.168439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.sql.core [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 12:06:50.168439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 12:06:50.168439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [parameters: {'user_id': 'b3a0f4e5d51d4619be194f164d55f010', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 12:06:50.168439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application conn.query(q) May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result.read() May 03 12:06:50.177468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:06:50.179171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application next(self.gen) May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application yield resource May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application next(self.gen) May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.session.rollback() May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.force_reraise() May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise self.value May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application session.commit() May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 12:06:50.180701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._prepare_impl() May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.session.flush() May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._flush(objects) May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application compat.raise_( May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application flush_context.execute() May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rec.execute(self) May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 12:06:50.181616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 12:06:50.182538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result = self._query(query) May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application conn.query(q) May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application result.read() May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 12:06:50.183514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b3a0f4e5d51d4619be194f164d55f010', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:50.185076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 12:06:50.186128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.187257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 486/979] 10.222.0.21 () {60 vars in 1131 bytes} [Tue May 3 12:06:49 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:50.187743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94617-49c1-497e-be68-a9b7cf1e3957 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:50.188511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:50.228554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:50.229504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:50.229787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:50.230147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:50.230773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:50.232146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:50.293052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dfa24-0e45-4dbe-af53-d595b3254f91 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:50.315050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 494/980] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:50 2022] POST /identity/v3/services => generated 242 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:06:50.353991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:50.355317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:50.355820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:50.356306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:50.366023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:50.368097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3ed67665-fe6b-4963-bf13-123ab4295d73 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:50.391388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:50.392459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 12:06:50.393441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:50.394001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 487/981] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:06:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:50.400670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:50.508635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53873d-10b4-4ee9-b743-901da4477783 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:50.544188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:50.544909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:50.545190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:50.545461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:50.546253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:50.546558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:50.547989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42864-b6ea-4cfe-aad7-f2aaa06013a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:50.585004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 495/982] 10.222.0.21 () {56 vars in 1101 bytes} [Tue May 3 12:06:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:51.160858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc649d-b24d-48e0-a7ed-9e288298129a None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.161486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc649d-b24d-48e0-a7ed-9e288298129a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.161486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc649d-b24d-48e0-a7ed-9e288298129a None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.162805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 488/983] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:51.168523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.168975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.169068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.186833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:51.188060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:51.253341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 496/984] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:51.275702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc649d-b24d-48e0-a7ed-9e288298129a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:51.380046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc649d-b24d-48e0-a7ed-9e288298129a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:51.412418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:51.413230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.413510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.413783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.414431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:51.415789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:51.428345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:51.429507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:51.430364 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:51.434590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 489/985] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:51.435925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:51.531897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa83d5-4446-4763-8092-6325890be5e1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:51.564817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:51.565484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.565767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.566041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.566732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:51.567037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:51.568446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:51.573749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 497/986] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:51.579285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:51.674460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de513d-2ac0-4450-99ad-d6c91324d39c None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:51.706136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:51.706800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.707079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.707352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.708055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:51.708481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:51.709831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:51.714818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 490/987] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:51.720612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:51.816381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d339e6-abbc-483c-b47f-84a2d959971c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:51.848481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:51.849166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.849455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.849730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.850514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] RBAC: Adding query filter params (interface=admin, service_id=7d8b5b2883374e4c985086e3441a370f, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:51.850824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:51.852190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e450-b8b4-422e-94d1-4be11e62d7e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:51.862180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 498/988] 10.222.0.21 () {56 vars in 1249 bytes} [Tue May 3 12:06:51 2022] GET /identity/v3/endpoints?service_id=7d8b5b2883374e4c985086e3441a370f&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:51.863348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:51.958870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6d655-ba26-4f67-9cb3-7de533f3e7e6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:51.991257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:51.991921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:51.992202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:51.992513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:51.993190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:51.994576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016678d-4cab-42f8-91c7-2f6914179762 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:52.008402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 491/989] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:51 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:06:52.334700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b96496-f8f5-4e6c-8d2f-3da927738ae0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.335207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b96496-f8f5-4e6c-8d2f-3da927738ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.335283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b96496-f8f5-4e6c-8d2f-3da927738ae0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.338382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 499/990] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:52.344442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.344442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.344442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.361109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:52.362607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:52.426023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 492/991] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:52.448287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b96496-f8f5-4e6c-8d2f-3da927738ae0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:52.547971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b96496-f8f5-4e6c-8d2f-3da927738ae0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:52.579616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:52.580419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.580702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.580970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.581604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:52.582962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e2cbdadf-7d0f-472d-8961-aca2322ff2e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:52.594892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:52.595866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:52.596776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.600454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 500/992] 10.222.0.21 () {56 vars in 1105 bytes} [Tue May 3 12:06:52 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:52.601935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:52.679154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c723b-541e-49a5-856f-ac5aea1a9c27 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.679469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c723b-541e-49a5-856f-ac5aea1a9c27 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.679714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c723b-541e-49a5-856f-ac5aea1a9c27 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.681212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 501/993] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:52.687305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.687587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.687860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.696712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d7f0-289e-4f4e-9aa6-37dd1ea5762c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:52.706919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:52.708090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:52.732266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:52.732965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.733246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.733525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.734224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] RBAC: Adding query filter params (name=image) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:52.734533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:52.735890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:52.740916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 493/994] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:52.746484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:52.797959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 502/995] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:52.822112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:52.848179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a2f3-2b59-43ce-b34a-5fbec0052e65 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:52.882378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:52.883035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.883313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.883582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.884277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] RBAC: Adding query filter params (type=image) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:52.884604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:52.886481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:52.890952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 494/996] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:52.937110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7517a-c7d7-4722-b420-7db2682eff6f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:52.972546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:52.973368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:52.973648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:52.973945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:52.974582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:52.975988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:52.989145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:52.990480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:52.991311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:52.996226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 503/997] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:52.997352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:53.100577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133be32-076b-4316-9922-b26c3b782492 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:53.135885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:53.136975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:53.137456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:53.137923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:53.138820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:53.139317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:53.140909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:53.146472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 495/998] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:53.152645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:53.251096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803d361-3e1f-48bd-85e5-0420d5320391 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:53.283671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:53.284338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:53.284644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:53.284919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:53.285620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:53.285922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:53.287284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:53.292126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 504/999] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:53.297829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:53.397950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd240e-da36-4429-ad83-e2f6a5044479 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:53.431777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:53.432476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:53.432754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:53.433018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:53.433786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] RBAC: Adding query filter params (interface=public, service_id=ce92d801771a4e5c895fbe5a8d3910d3, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:53.434085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:53.435420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430e5c5-9b86-46fe-b8c5-50c0250db73d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:53.440499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 496/1000] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:53 2022] GET /identity/v3/endpoints?service_id=ce92d801771a4e5c895fbe5a8d3910d3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:53.446246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:53.544524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e927c2-fb6c-467c-b0d7-5eea6a8b301d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:53.577267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:53.578273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:53.578762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:53.579242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:53.580140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:53.581729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528216c-a9f9-41bf-b20c-9ea202332edc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:53.588791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 505/1001] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:53 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:06:54.280907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c748-8d5a-4f94-be9b-6ae8067a20a2 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.281260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c748-8d5a-4f94-be9b-6ae8067a20a2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.281452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c748-8d5a-4f94-be9b-6ae8067a20a2 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.282950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 497/1002] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:54.288036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.288414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.288764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.305723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:54.306876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:54.380409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 506/1003] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:54.400671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c748-8d5a-4f94-be9b-6ae8067a20a2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:54.497057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c748-8d5a-4f94-be9b-6ae8067a20a2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:54.529206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:54.530005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.530279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.530546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.531231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:54.532773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:54.544181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:54.545199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 12:06:54.546027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:54.548709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 498/1004] 10.222.0.21 () {56 vars in 1126 bytes} [Tue May 3 12:06:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:54.551510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:54.648226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f955-0ada-4c6c-a19e-0cc59a7398ed None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:54.681256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:54.681944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.682222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.682493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.683187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:54.683488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:54.684876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:54.694118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 507/1005] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:54.695168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:54.791012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0066-3cf6-4bfd-b498-fa04d3f9bac1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:54.822536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:54.823694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.823973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.824243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.824971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:54.825269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:54.826611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0134-fae1-4b86-8c09-08b482c4e4a8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:54.835798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 499/1006] 10.222.0.21 () {56 vars in 1122 bytes} [Tue May 3 12:06:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:54.836797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:54.931476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13ed-2bfc-46bc-a157-49e512209fae None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:54.963895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:54.964608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:54.964891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:54.965161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:54.965911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:54.967319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23cc3c-c226-43e5-ae2a-60c32bbf2c72 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:55.043870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 508/1007] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:55.161179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb48c-dc89-449a-80bd-9e46907ccbc7 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:55.161517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb48c-dc89-449a-80bd-9e46907ccbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:55.161742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb48c-dc89-449a-80bd-9e46907ccbc7 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:55.163412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 500/1008] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:55.169179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9378e0-6144-4518-acf4-ddceb2fff7cb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:55.169514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9378e0-6144-4518-acf4-ddceb2fff7cb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:55.169745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9378e0-6144-4518-acf4-ddceb2fff7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:55.188502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e9378e0-6144-4518-acf4-ddceb2fff7cb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:55.189706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e9378e0-6144-4518-acf4-ddceb2fff7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:55.264749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 509/1009] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:06:55.288796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eb48c-dc89-449a-80bd-9e46907ccbc7 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:55.388838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eb48c-dc89-449a-80bd-9e46907ccbc7 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:55.420738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:55.421404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:55.421666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:55.421934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:55.422643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:55.424009 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaddc22-d4b4-49e1-b598-6bd07074bd23 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:55.518213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 501/1010] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:55 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:55.851044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a5ae-d450-47fc-85b9-0d7388ed85fd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:55.851564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a5ae-d450-47fc-85b9-0d7388ed85fd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:55.851667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a5ae-d450-47fc-85b9-0d7388ed85fd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:55.853119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 510/1011] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:55.858098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:55.858394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:55.858675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:55.875679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:55.876903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:55.946485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 502/1012] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:55.969093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0a5ae-d450-47fc-85b9-0d7388ed85fd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:56.065096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0a5ae-d450-47fc-85b9-0d7388ed85fd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:56.096617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:56.097404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:56.097741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:56.098025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:56.098669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:56.100030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:56.112300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:56.113286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 12:06:56.114116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:56.115424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 511/1013] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:06:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:56.120334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:56.215309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109a84-0d35-456a-bc4d-cf49e048f553 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:56.248502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:56.249169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:56.249447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:56.249718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:56.250410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:56.250711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:56.252064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:56.261304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 503/1014] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:56.263043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:56.361232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdca54-5dcc-41b7-86e2-954cca2f02a2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:56.459391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:56.459979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:56.460261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:56.460565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:56.461259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:56.461562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:56.463482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cac56-3077-4b4e-8bc4-24dfd45a2b41 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:56.468288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 512/1015] 10.222.0.21 () {56 vars in 1112 bytes} [Tue May 3 12:06:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:56.473864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:56.569151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27467e0-d72b-4cae-88ed-203bb38b0372 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:56.602714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:56.603429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:56.604301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:56.604606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:56.605354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:56.606716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcc1c3-bded-47f1-8b42-540bd61ec158 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:56.712476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 504/1016] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:06:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:57.334523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e57bd-d7e0-40e3-b912-27e52b990d84 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.335038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e57bd-d7e0-40e3-b912-27e52b990d84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.335038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e57bd-d7e0-40e3-b912-27e52b990d84 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.336756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 513/1017] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:57.342568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753862-ce49-440d-9455-02d5120db547 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.343110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753862-ce49-440d-9455-02d5120db547 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.343601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753862-ce49-440d-9455-02d5120db547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.362315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-34753862-ce49-440d-9455-02d5120db547 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:57.363474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-34753862-ce49-440d-9455-02d5120db547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:57.433570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 505/1018] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:57.456806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e57bd-d7e0-40e3-b912-27e52b990d84 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:57.554479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e57bd-d7e0-40e3-b912-27e52b990d84 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:57.586980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:57.587723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.588005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.588285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.589617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:57.591087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a907c0-d512-4505-a481-2fc117af4b87 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:57.593062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 514/1019] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:57.599069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753862-ce49-440d-9455-02d5120db547 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:57.696028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753862-ce49-440d-9455-02d5120db547 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:57.727567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:57.728264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.729110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.729382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.730086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:57.731495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:57.783909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb4d9-d337-46a1-aae2-f8ae5c4c9274 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.784197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb4d9-d337-46a1-aae2-f8ae5c4c9274 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.784510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cb4d9-d337-46a1-aae2-f8ae5c4c9274 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.785902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 515/1020] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:06:57.790833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:57.791698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:57.791983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:57.798921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 506/1021] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:06:57 2022] POST /identity/v3/projects => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:06:57.810075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:57.811462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:57.882548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 516/1022] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:57.905894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:58.008657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ef97-c644-44d3-969f-3589dc02536a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:58.043393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:58.044193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:58.044501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:58.044773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] PATH_INFO: `/v3/services/image` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:58.045428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:58.046792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:58.058763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:58.059742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:06:58.060627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 507/1023] 10.222.0.21 () {56 vars in 1105 bytes} [Tue May 3 12:06:57 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:58.065900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:58.160957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096a6d-26f6-41f1-940c-597591a82a9c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:58.192951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:58.193619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:58.193903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:58.194177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:58.194875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] RBAC: Adding query filter params (name=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:58.195182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:58.196637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:58.202109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 517/1024] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:58.207889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:58.302000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12687f2a-dd13-44ba-8c68-03ecb74c208e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:58.339707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:58.340394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:58.340689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:58.340967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:58.344095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] RBAC: Adding query filter params (type=image) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:58.344095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:58.344095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:58.349976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 508/1025] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:58.355912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:58.452155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ac51-bcc0-4031-ae77-d11efbbb2295 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:58.484697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:58.485359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:58.485639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:58.485916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:58.486694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] RBAC: Adding query filter params (interface=public, service_id=9c3b95f5b6354c3492073ed214960f0a, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:58.487003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:58.488392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb7f3a-88bd-47ae-91ed-d32ff413aa76 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:58.497800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 518/1026] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:06:58 2022] GET /identity/v3/endpoints?service_id=9c3b95f5b6354c3492073ed214960f0a&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:58.499220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:58.595150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aeefb-e0dc-49b7-aac5-a362955727dd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:58.626980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:58.627729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:58.627913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:58.628186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:58.628891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:58.630269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bd4a-dc7b-4861-8509-6184373f7e78 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:58.644408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 509/1027] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:06:58 2022] GET /identity/v3/services => generated 1957 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:06:59.073086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b34e9-8039-4cfb-be56-fc79999b7cf1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.073382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b34e9-8039-4cfb-be56-fc79999b7cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.073701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b34e9-8039-4cfb-be56-fc79999b7cf1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.079107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 519/1028] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:06:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:06:59.085196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.085484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.085758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.106714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:06:59.107933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:06:59.170768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 510/1029] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:06:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:06:59.194190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b34e9-8039-4cfb-be56-fc79999b7cf1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:59.289002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b34e9-8039-4cfb-be56-fc79999b7cf1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:59.321392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:59.322216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.322493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.322757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.336300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:06:59.345172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:59.346102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:59.346971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 520/1030] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:59.352621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:59.450192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0450b-7ee4-43e2-b2db-971c489bbf5d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:59.485333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:59.485995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.486268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.486532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.487265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:59.487559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:59.488932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:59.501296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 511/1031] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:06:59.502549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:59.602540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d8196-4e7d-4736-a9e8-4725d46999c7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:59.634383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:59.635704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.635982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.636249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.646286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:59.647712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:06:59.664590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:59.665488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:59.670995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:06:59.670995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:06:59.670995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:06:59.670995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:59.670995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 521/1032] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:06:59.671854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:59.766164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bb9ce-55c7-44e4-9c68-3e7fa900d190 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:59.799424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:59.800089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.800438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.800920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.801607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:06:59.801902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:59.803242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:59.819280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 512/1033] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:06:59.820507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:06:59.913557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83abb6-9fc5-463b-9715-cdceac5204f1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:06:59.947998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:06:59.948876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:06:59.949155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:06:59.949424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:06:59.957973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:06:59.959456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9f853160-dc2d-4d89-bf03-7e80a128c1d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:06:59.974274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:06:59.975257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:06:59.976192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 522/1034] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:06:59.983020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.076344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26b4e0-ebf9-4820-a96f-858d6f513a63 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.108895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.109556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.109831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.110099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.110916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:00.111214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.112721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.127083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b311-6416-4a0f-b833-3457872b60de None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.127366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b311-6416-4a0f-b833-3457872b60de None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.127652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b311-6416-4a0f-b833-3457872b60de None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.129046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 523/1035] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:07:00.129890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 513/1036] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:06:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:00.134319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.134607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.134999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.135689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.151707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:00.152900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:00.217726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 524/1037] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:00.235034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531361d-1801-4829-848f-a8ff9bee3db6 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.242786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.267367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.268004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.268278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.268589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.333090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.336011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.339086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8a43-e4c6-48b9-90fa-fec34d337225 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.373549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.374341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.374616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.374879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.376035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.377490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.379308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 525/1038] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:00.385321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.432561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 514/1039] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:00.438115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.479476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d1f5-d359-4320-9fdc-79f9c20c76a5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.513773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.515607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.516136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.516585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.517849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.519472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.531958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ceef3-1d20-400a-8091-238ca8fd2369 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.563892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.564729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.565006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.565275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.575295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.576731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:00.593846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:00.595119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:00.596038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:00.596038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:00.596038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:00.596038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:00.596038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 515/1040] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:00.600510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.628394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 526/1041] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:07:00 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:07:00.707027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327867e-09ae-4493-a7b5-11fbca394401 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.745383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.745977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.746259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.746533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.747263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:00.747567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.748988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ad18a-2e63-477b-b24d-3c1de3f6c586 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.761597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 516/1042] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:00.766969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.869592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee0fe-d759-4c63-a499-6224c46c26b2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:00.900286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cf5a-6a1c-4c32-bc6c-1c2893e13e2f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.900714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cf5a-6a1c-4c32-bc6c-1c2893e13e2f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.900920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cf5a-6a1c-4c32-bc6c-1c2893e13e2f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.902414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 517/1043] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:00.902700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:00.903500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.903777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.904054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.907882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:00.908168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:00.908480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:00.911553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:00.913333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:00.926030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:00.927182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:07:00.928242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:00.929173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:00.930065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 527/1044] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:00.936789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:00.998633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 518/1045] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:07:01.017056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:01.030923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e406-b0d9-4563-a8a1-35702c01f64c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.064139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.065156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.065627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.066069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.067019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:01.067497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.069116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.082204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 528/1046] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:01.087844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:01.113889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa473b-e20d-4fff-ad23-c232724fc923 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.147299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.148084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.148373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.148662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] PATH_INFO: `/v3/services/image` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.149298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.150691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:01.161865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:01.162863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:01.163711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 519/1047] 10.222.0.21 () {56 vars in 1105 bytes} [Tue May 3 12:07:01 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:01.169303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:01.190915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f866-a030-4ea7-9c9d-2a8b7aef5a31 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.223001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.223644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.223925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.224189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.225457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] RBAC: Adding query filter params (role.id=a921a2f9b3d242519885c2dcc0c1ba9a, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:01.225457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.226741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.244591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 529/1048] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:01 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=a921a2f9b3d242519885c2dcc0c1ba9a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:01.267035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac521-492c-437d-9b1f-c9741cf58410 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.303138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.303809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.304084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.304351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.305086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] RBAC: Adding query filter params (name=image) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:01.305383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.307373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.316553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 520/1049] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:01.319009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:01.442226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735947f-a484-4bed-a0e8-1ee2f5424f2a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.475091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.475750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.476025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.476292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.477005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] RBAC: Adding query filter params (type=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:01.477303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.479196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8727-0925-4609-8b99-1034768cf613 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.488507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 530/1050] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:01.490077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:01.586556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbafcd-3c96-4ce9-b37a-03704c19e15b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:01.619261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:01.619916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:01.620195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:01.620494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:01.621240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:01.622664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425488db-78e8-401e-8b2e-09aaeb6e0eac None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:01.736390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 521/1051] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:07:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:07:03.077035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfa3a-fc4a-44db-865a-96eb8fbf6cc7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.077591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfa3a-fc4a-44db-865a-96eb8fbf6cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.077591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfa3a-fc4a-44db-865a-96eb8fbf6cc7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.079072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 531/1052] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:03.083955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.084334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.084533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.100554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:03.101703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:03.169688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 522/1053] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:03.192649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dfa3a-fc4a-44db-865a-96eb8fbf6cc7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.293783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dfa3a-fc4a-44db-865a-96eb8fbf6cc7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.344079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.344079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.344079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.344079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.350102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bb9b1881-72f3-4c72-bfa1-eeec20813f36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:03.358238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:03.359159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:03.369897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 532/1054] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:03.370613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.460660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975929-5f51-401a-b9cf-823ff41b7c42 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.490267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1955-dd25-4d48-b6a6-6e760bbc5d10 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.490267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1955-dd25-4d48-b6a6-6e760bbc5d10 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.490540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1955-dd25-4d48-b6a6-6e760bbc5d10 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.491866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 533/1055] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:07:03.497215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.497499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.497848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.500743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.501413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.501697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.501974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.502723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:03.503029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:03.504400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:03.516990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 523/1056] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:03.518408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:03.518523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.519588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:03.584992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 534/1057] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:07:03.607647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.613985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46abcf-1e19-4036-9373-3e4303c47f47 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.647038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.647905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.648185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.648492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] PATH_INFO: `/v3/users/76826eab08054206810cf0d12e38b21b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.661488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] RBAC: Authorizing `identity:get_user(user_id=76826eab08054206810cf0d12e38b21b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:03.662923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:03.668409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 524/1058] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/users/76826eab08054206810cf0d12e38b21b => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:03.671534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.707694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee466be-a484-4b7b-9fbc-6b75ed35ff9a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.741544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.742637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.743125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.743597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.754184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:03.762352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:03.763275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:03.764267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 535/1059] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:03.766629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8ff7-3f9f-4e5b-b821-bc770e8363a5 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.769629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.801851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.802510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.802785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.803053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.872329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:03.873746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:03.873949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a50995-9248-4113-9e86-f162aa4fa679 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:03.906052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:03.906717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:03.906992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:03.907258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:03.907985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:03.908284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:03.909680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:03.922788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 536/1060] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:03.923617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:03.969696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 525/1061] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:03.975327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.018557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70e7f-431b-4b47-8990-cb6220e709eb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.050808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.051592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.051872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.052145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.063023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.064497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.065946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1afcd2-3294-4727-a3a0-75c09264ce89 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-202e1e2f-233a-4f8b-8bc8-6a178bc9d3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:04.081437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:04.082724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:04.083613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:04.083613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:04.083613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.083613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:04.083613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 537/1062] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:04.083885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3daca-534e-41f4-9a4b-242cf2bb0099 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.084455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3daca-534e-41f4-9a4b-242cf2bb0099 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.084455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3daca-534e-41f4-9a4b-242cf2bb0099 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.085692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 538/1063] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:04.088723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3daca-534e-41f4-9a4b-242cf2bb0099 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.098300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.099155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.099434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.099708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.100919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.102344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0aee-09e6-4292-8ded-ca12e08363d3 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.104715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 526/1064] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:03 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:04.105852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.106137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.106413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.121893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:04.123111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:04.183888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3daca-534e-41f4-9a4b-242cf2bb0099 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.185415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 527/1065] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:04.186063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.217288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.218016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.218357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.218692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.219464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:04.219832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.221310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.232626 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 539/1066] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:04.233421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.279546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d7527-94ae-4e66-a42a-089d9f240ca9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.310958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.311599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.311879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.312150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.313015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=aa191bea8f614538bfb0567d9a172508, user.id=76826eab08054206810cf0d12e38b21b) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:04.313326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.314739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.319977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 528/1067] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/role_assignments?user.id=76826eab08054206810cf0d12e38b21b&scope.project.id=aa191bea8f614538bfb0567d9a172508&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:04.320773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.335830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339fa7c-cdb7-437f-a7c7-a47545463299 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.372691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.373402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.373637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.373897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.426611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9b82-5979-4656-b042-34ec50d90dc2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.451771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.453281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.463348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.464160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.464471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.464747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.472583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.474044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:07:04.489349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:04.490369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:07:04.491319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:04.495625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 529/1068] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:04.496376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.554287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 540/1069] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:04.560483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.593999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8971f-95a9-42e9-ab99-93659c2c5e3f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.627070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.627672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.627950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.628224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.629141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:04.629446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.630877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.648071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 530/1070] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:04.653885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.655964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28c130-7e72-4029-b557-d1f4c26d40f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.689659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.690448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.690727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.690997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.701431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.702920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:04.720014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:04.721261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:04.722160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:04.722160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:04.722160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.722160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:04.724689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 541/1071] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:04.726885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.752485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bfca-8784-435a-8a5d-f81610d9caab None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.788239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.789058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.789344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.789620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.800189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.801937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:04.819368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:04.820275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:04.821213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:04.821213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:04.821213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:04.821213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:04.821213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 531/1072] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:04.826610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:04.829038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85b302-f1a4-41e1-949b-f908547ed184 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.861550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.862499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.863024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.863478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.864388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:04.864872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.866412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.888478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 542/1073] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:04.923545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8e7f6-b427-4db3-a29d-2a877c8fd3f8 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:04.958858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:04.959532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:04.959812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:04.960137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:04.960906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:04.961258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:04.962704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:04.979998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 532/1074] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:04.981658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:05.082969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaeed-0bcc-4720-bcca-bcd4e9ae2903 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:05.116392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:05.117221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:05.117499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:05.117774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:05.125517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:05.126950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:07:05.141441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:05.142347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:05.143306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 543/1075] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:05.148443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:05.248577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834330-2e3b-4016-877f-5bcc3fedb771 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:05.279584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:05.280236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:05.280552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:05.280824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:05.281604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:05.281909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:05.283324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074dbc6-d227-411a-a5de-b4cb4325c5b8 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:05.295393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 533/1076] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:05.301493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:05.402269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72ae76-956d-4cee-b649-09ffd0246191 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:05.434546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:05.435442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:05.435720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:05.435987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/a921a2f9b3d242519885c2dcc0c1ba9a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:05.438309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=1222910d5aea4308ae5083faf6bc753a, role_id=a921a2f9b3d242519885c2dcc0c1ba9a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:05.439776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fef04-bd5f-4b3d-9039-63c416b0cfd6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:05.516704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 544/1077] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:07:05 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/1222910d5aea4308ae5083faf6bc753a/roles/a921a2f9b3d242519885c2dcc0c1ba9a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:07:06.558530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4db-789d-4b26-8102-288964c3e35b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:06.559081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4db-789d-4b26-8102-288964c3e35b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:06.559081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb4db-789d-4b26-8102-288964c3e35b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:06.560463 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 534/1078] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:06.565793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:06.566219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:06.566348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:06.582492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:06.583664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:06.648687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 545/1079] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:06.671603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb4db-789d-4b26-8102-288964c3e35b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:06.768222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb4db-789d-4b26-8102-288964c3e35b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:06.801642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:06.802420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:06.802701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:06.802971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:06.812526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:06.820105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:06.821217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:06.822145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:06.824522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 535/1080] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:06.827283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:06.919491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbab3c-981e-496b-925c-23fadb44a38b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:06.950820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:06.951477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:06.951754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:06.952023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:06.952790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:06.953090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:06.954443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:06.962171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 546/1081] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:06.968753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:07.062613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58a50-0aa1-48a6-893c-5acf9439b91b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:07.094283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:07.095149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.095429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.095701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] PATH_INFO: `/v3/users/76826eab08054206810cf0d12e38b21b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:07.096903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] RBAC: Authorizing `identity:get_user(user_id=76826eab08054206810cf0d12e38b21b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:07.098342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:07.100165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 536/1082] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:06 2022] GET /identity/v3/users/76826eab08054206810cf0d12e38b21b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:07.106898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:07.201964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ecec1-6226-4b36-ac22-4a37b693c289 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:07.233530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:07.234381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.234661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.234934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:07.236096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:07.237575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f655e-3db6-43db-ac73-551c0d0bd8cc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:07.239408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 547/1083] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:07 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:07.245155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:07.340152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5e7e9-a771-496d-8c45-53cd33bcc209 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:07.371756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:07.372684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.372968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.373239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508/users/76826eab08054206810cf0d12e38b21b/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:07.375163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa191bea8f614538bfb0567d9a172508, user_id=76826eab08054206810cf0d12e38b21b, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:07.376607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2ee7e-ed3d-4951-a9ef-d6f1ebb228b2 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:07.459496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 537/1084] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:07:07 2022] PUT /identity/v3/projects/aa191bea8f614538bfb0567d9a172508/users/76826eab08054206810cf0d12e38b21b/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:07:07.755141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8df4-1430-47a8-b833-ab1d1567995c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.755658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8df4-1430-47a8-b833-ab1d1567995c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.755658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8df4-1430-47a8-b833-ab1d1567995c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:07.757003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 548/1085] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:07.762770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.763200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.763308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:07.779248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:07.780425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:07.843125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 538/1086] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:07.866282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8df4-1430-47a8-b833-ab1d1567995c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:07.961492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8df4-1430-47a8-b833-ab1d1567995c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:07.992307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:07.993122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:07.993401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:07.993696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.003547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:08.012238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:08.013273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:08.014120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 549/1087] 10.222.0.21 () {56 vars in 1120 bytes} [Tue May 3 12:07:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:08.019467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.111100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fcf2-db44-4bbe-b6e3-c7924f3b47bf None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.143010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.143674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.143956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.144229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.145008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:08.145311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.146662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:08.154978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 539/1088] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:08.160622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.253888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097fdb9-a421-4cda-a27b-ab26e24aeda0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.286009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.286732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.287008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.287274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.297394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.298823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:08.315864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:08.316841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:08.317747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:08.317747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:08.317747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:08.317747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:08.317747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 550/1089] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:08.322705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.417505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228e09-662f-4e86-9428-beb390897ad1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.448807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.449465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.449746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.450018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.450732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:08.451035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.452413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:08.464070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 540/1090] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:08.470148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.564981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976db98-cd76-4174-beed-e624b820e10b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.599563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.600349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.600653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.600924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.609365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.610784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:07:08.624721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:08.625699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:08.626650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 551/1091] 10.222.0.21 () {56 vars in 1093 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:08.631620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.723145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef23d5-f2d9-4f39-80ce-665c6882473f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.753447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.754088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.754363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.754632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.755439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:08.755739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.757160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:08.779977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 541/1092] 10.222.0.21 () {56 vars in 1133 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:08.785496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:08.878036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997cfa-c07f-4fa2-a62f-721d36b8569e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:08.909990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:08.910621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:08.910897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:08.911163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:08.974170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:08.975594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.065759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 552/1093] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 12:07:09.071372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.163906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a77c-5a20-4cb8-99c1-db567702461e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.196535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.197878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.198159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.198434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.207934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:09.209396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:09.225958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:09.226806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:09.227729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:07:09.227729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:09.227729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:07:09.227729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:09.227729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 542/1094] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:09.232915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.325842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ff3-908e-4603-b1fc-a87d1ea67937 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.358428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.359094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.359378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.359654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.360371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:09.360721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:09.362067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.373646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 553/1095] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:09.379235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.471946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d0e7-9ee4-4362-989c-76401886788a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.505065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.505896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.506176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.506448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.514091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:09.515566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:07:09.530161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:09.531203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:09.532511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 543/1096] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:09.537292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.631284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c725-d0e2-4384-bb15-ce6e548a66b9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.662145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.662794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.663074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.663343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.664104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:09.664431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:09.666388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d984c-a358-4e38-a075-a0ad9d84389d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.678202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 554/1097] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:09.684608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.687829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f90a-9af8-4983-98fc-8415656279b0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.688112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f90a-9af8-4983-98fc-8415656279b0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.688407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f90a-9af8-4983-98fc-8415656279b0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.689693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 555/1098] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:07:09.694529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.694809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.695083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.710568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:09.711740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:09.773176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 556/1099] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:07:09.777949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cd145-d4b2-49c8-8787-a5bf4179c600 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.797026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:09.809395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.810037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.810314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.810585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.811400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] RBAC: Adding query filter params (role.id=a921a2f9b3d242519885c2dcc0c1ba9a, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=1222910d5aea4308ae5083faf6bc753a) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:09.811704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:09.813210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:09.818849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 544/1100] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/role_assignments?user.id=1222910d5aea4308ae5083faf6bc753a&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=a921a2f9b3d242519885c2dcc0c1ba9a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:09.894903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231a3b-753a-4ca2-ba88-44b946bb786e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:09.930215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:09.931055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:09.931332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:09.931600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:09.942193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:09.950131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:09.951193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:09.952032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 557/1101] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:07:09.957521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:10.055578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0303d-c3f0-49a3-b1af-17aa754275e1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:10.088105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:10.088803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:10.089080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:10.089356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:10.090094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:10.090397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:10.091757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:10.101075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 545/1102] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:10.107616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:10.207115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c907f1-4614-4f0b-b26c-113b8faf3e56 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:10.239353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:10.240216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:10.240527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:10.240802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] PATH_INFO: `/v3/users/76826eab08054206810cf0d12e38b21b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:10.241990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] RBAC: Authorizing `identity:get_user(user_id=76826eab08054206810cf0d12e38b21b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:10.243437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:10.245246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 558/1103] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:10 2022] GET /identity/v3/users/76826eab08054206810cf0d12e38b21b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:10.251015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:10.347281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315a05-309b-4ea0-9288-0e3ad3adfe84 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:10.380294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:10.380988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:10.381258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:10.381528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:10.445669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:10.447617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:10.542294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 546/1104] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:10.548419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:10.645291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5dde1-5013-43d3-b3cd-d858130e4e52 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:10.677091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:10.677944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:10.678223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:10.678492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:10.679639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:10.681616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5190-b5f2-4db4-bee0-3b6d33d50fe4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:10.683279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 559/1105] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:10 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:10.689343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:10.785654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9c3c-26a9-4ae4-b04e-bb9cfa681edd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:10.816810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:10.817450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:10.817726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:10.817995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:10.818802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=aa191bea8f614538bfb0567d9a172508, user.id=76826eab08054206810cf0d12e38b21b) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:10.819108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:10.820532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434fce0-30ec-4705-bf2e-03e7b2159073 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:10.826580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 547/1106] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:10 2022] GET /identity/v3/role_assignments?user.id=76826eab08054206810cf0d12e38b21b&scope.project.id=aa191bea8f614538bfb0567d9a172508&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:13.074790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874b5c-da64-4c24-a519-8829f6e12af4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:13.075369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874b5c-da64-4c24-a519-8829f6e12af4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:13.075369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874b5c-da64-4c24-a519-8829f6e12af4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:13.076894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 560/1107] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:13.081905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:13.082346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:13.082454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:13.098878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:13.100033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:13.161516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 548/1108] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:13.185510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5874b5c-da64-4c24-a519-8829f6e12af4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:13.280252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5874b5c-da64-4c24-a519-8829f6e12af4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:13.312003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:13.312801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:13.313080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:13.313347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:13.314499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:13.315912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd2f2-bed1-4655-8c08-bd71119cca20 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:13.317501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 561/1109] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:13.322936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:13.413591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4b69-97c5-4992-a7c1-d5523f78ff44 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:13.445795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:13.446474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:13.446757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:13.447030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:13.447729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:13.449192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683478c1-c869-4437-a556-ac0f06792848 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:13.533204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 549/1110] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:07:13 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:07:15.803084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4101-501f-4a8f-809d-8e344b93f629 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:15.803605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4101-501f-4a8f-809d-8e344b93f629 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:15.803605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4101-501f-4a8f-809d-8e344b93f629 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:15.805047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 562/1111] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:15.810747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:15.811137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:15.811299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:15.828670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:15.829844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:15.890547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 550/1112] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:15.913476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b4101-501f-4a8f-809d-8e344b93f629 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:16.008790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b4101-501f-4a8f-809d-8e344b93f629 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:16.039859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:16.041285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:16.041564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:16.041835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] PATH_INFO: `/v3/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:16.043285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] RBAC: Authorizing `identity:get_role(role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:16.044689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:16.045988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 563/1113] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:15 2022] GET /identity/v3/roles/d718902dd4844e5cade3e242453c139a => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:16.051856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:16.142355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ca83-d867-4a02-8726-f605a94867ae None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:16.173411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:16.174251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:16.174526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:16.174794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] PATH_INFO: `/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:16.187039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] RBAC: Authorizing `identity:get_user(user_id=9e4f4fa4a3714aa3826b1c69eb0acd42)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:16.188495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:16.190092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 551/1114] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:16 2022] GET /identity/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:16.195777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:16.288928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339339d-33ea-4645-9d7c-94a781d8319c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:16.320180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:16.320999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:16.321783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:16.322058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:16.385217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:16.386654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:16.478937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 564/1115] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:16.484821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:16.578062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cf2aa-a09d-453d-b55e-f6ea7f7f7cbe None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:16.608754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:16.609599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:16.609876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:16.610150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:16.611304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:16.612749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48977f-3b93-4d66-988f-d486fc3d02f9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:16.614408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 552/1116] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:16 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:16.621358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:16.714889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466f06d-7488-472e-b107-8b3777b378a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:16.747273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:16.747852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:16.748131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:16.748427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:16.749255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=aa191bea8f614538bfb0567d9a172508, user.id=9e4f4fa4a3714aa3826b1c69eb0acd42) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:16.752696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:16.752696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaf413-a22e-400c-9bd9-3a71bc3e3021 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:16.756455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 565/1117] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:16 2022] GET /identity/v3/role_assignments?user.id=9e4f4fa4a3714aa3826b1c69eb0acd42&scope.project.id=aa191bea8f614538bfb0567d9a172508&role.id=d718902dd4844e5cade3e242453c139a => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:18.951964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c02ca-4a44-4a80-ae80-f244dbd320d3 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:18.952558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c02ca-4a44-4a80-ae80-f244dbd320d3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:18.952558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c02ca-4a44-4a80-ae80-f244dbd320d3 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:18.953900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 553/1118] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:18.959066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:18.959487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:18.959619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:18.976228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:18.978032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:19.038946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 566/1119] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:07:19.061719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c02ca-4a44-4a80-ae80-f244dbd320d3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:19.154832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c02ca-4a44-4a80-ae80-f244dbd320d3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:19.185468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:19.186284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:19.186560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:19.186826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] PATH_INFO: `/v3/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:19.188251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] RBAC: Authorizing `identity:get_role(role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:19.189627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:19.190950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 554/1120] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:19 2022] GET /identity/v3/roles/d718902dd4844e5cade3e242453c139a => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:19.197179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:19.289611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ede3b-6ff2-412e-9f79-7af63455a4c9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:19.320846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:19.322223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:19.322505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:19.322777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] PATH_INFO: `/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:19.323945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] RBAC: Authorizing `identity:get_user(user_id=9e4f4fa4a3714aa3826b1c69eb0acd42)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:19.325385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:19.326963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 567/1121] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:19 2022] GET /identity/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:19.332750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:19.425789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82c3c3-2930-4543-b128-051aef8e2f59 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:19.457360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:19.458189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:19.458470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:19.458745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:19.459898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:19.461340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b70ee3-6576-4542-968e-6e4a74378edd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:19.463592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 555/1122] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:19 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:19.469551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:19.567073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af4d69-3ff0-4325-a883-edaaf6c2097b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:19.598128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:19.598991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:19.599266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:19.599530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508/users/9e4f4fa4a3714aa3826b1c69eb0acd42/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:19.601690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa191bea8f614538bfb0567d9a172508, user_id=9e4f4fa4a3714aa3826b1c69eb0acd42, role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:19.603092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea78a4-facb-44d0-8ddb-c0e7ac1252d7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:19.681065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 568/1123] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:07:19 2022] PUT /identity/v3/projects/aa191bea8f614538bfb0567d9a172508/users/9e4f4fa4a3714aa3826b1c69eb0acd42/roles/d718902dd4844e5cade3e242453c139a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:07:21.880780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6955-4516-4d2b-9b57-a08322c3dfa4 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:21.881318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6955-4516-4d2b-9b57-a08322c3dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:21.881318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6955-4516-4d2b-9b57-a08322c3dfa4 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:21.882674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 556/1124] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:21.887784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:21.888165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:21.888331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:21.904801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:21.905957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:21.966979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 569/1125] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:21.990612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6955-4516-4d2b-9b57-a08322c3dfa4 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:22.083459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6955-4516-4d2b-9b57-a08322c3dfa4 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:22.116002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:22.116869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:22.117146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:22.117412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] PATH_INFO: `/v3/roles/d718902dd4844e5cade3e242453c139a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:22.118887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] RBAC: Authorizing `identity:get_role(role_id=d718902dd4844e5cade3e242453c139a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:22.120241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:22.121606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 557/1126] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:21 2022] GET /identity/v3/roles/d718902dd4844e5cade3e242453c139a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:22.127340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:22.218926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318717-eec7-416f-86ec-ad1f0e007db4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:22.251465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:22.252309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:22.252612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:22.252880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] PATH_INFO: `/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:22.254023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] RBAC: Authorizing `identity:get_user(user_id=9e4f4fa4a3714aa3826b1c69eb0acd42)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:22.255423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:22.257011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 570/1127] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:22 2022] GET /identity/v3/users/9e4f4fa4a3714aa3826b1c69eb0acd42 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:22.262606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:22.355066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8260-8811-4440-a4d5-1e98262e0df3 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:22.386805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:22.387433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:22.387708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:22.387975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:22.449033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:22.450444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:22.539270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 558/1128] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:22.545617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:22.637903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f02ce-28ab-480c-b892-5ac62c01103c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:22.669562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:22.670404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:22.670687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:22.670961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] PATH_INFO: `/v3/projects/aa191bea8f614538bfb0567d9a172508` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:22.672122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] RBAC: Authorizing `identity:get_project(project_id=aa191bea8f614538bfb0567d9a172508)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:22.673577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5d464-f0fa-45ba-a790-06607125ae60 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:22.675490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 571/1129] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:22 2022] GET /identity/v3/projects/aa191bea8f614538bfb0567d9a172508 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:22.682099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:22.773574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d2c63-860d-414a-8284-79e9fbbe2687 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:22.804761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:22.805868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:22.806151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:22.806425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:22.807242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] RBAC: Adding query filter params (role.id=d718902dd4844e5cade3e242453c139a, scope.project.id=aa191bea8f614538bfb0567d9a172508, user.id=9e4f4fa4a3714aa3826b1c69eb0acd42) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:22.807550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:22.808990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05521d9-bc2d-494f-9066-ce3389a89ff5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:22.814506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 559/1130] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:22 2022] GET /identity/v3/role_assignments?user.id=9e4f4fa4a3714aa3826b1c69eb0acd42&scope.project.id=aa191bea8f614538bfb0567d9a172508&role.id=d718902dd4844e5cade3e242453c139a => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:25.051238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d46a6-d01e-4ee2-9bf5-3cd305d3479b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:25.051777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d46a6-d01e-4ee2-9bf5-3cd305d3479b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:25.051777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d46a6-d01e-4ee2-9bf5-3cd305d3479b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:25.053163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 572/1131] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:25.058352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:25.058769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:25.058908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:25.075078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:25.076241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:25.138122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 560/1132] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:25.161770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d46a6-d01e-4ee2-9bf5-3cd305d3479b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:25.255252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d46a6-d01e-4ee2-9bf5-3cd305d3479b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:25.287029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:25.287796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:25.288076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:25.288347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:25.289582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:25.290997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828271-ac23-4b0b-8e55-5e60f4639925 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:25.292594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 573/1133] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:25.298193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:25.390070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86187-29f7-47a2-9e2f-a934a8c1e549 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:25.421312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:25.421952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:25.422232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:25.422501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:25.423202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:25.424640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26c0f-e2f4-48ac-b167-a5d0ff374d5d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:25.562578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 561/1134] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:07:25 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:07:27.803394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b438ef-29ad-42c3-871e-e889447967e3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:27.803896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b438ef-29ad-42c3-871e-e889447967e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:27.803896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b438ef-29ad-42c3-871e-e889447967e3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:27.805225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 574/1135] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:27.810235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:27.810642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:27.810788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:27.827711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:27.828979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:27.890410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 562/1136] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:27.915288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b438ef-29ad-42c3-871e-e889447967e3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:28.008830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b438ef-29ad-42c3-871e-e889447967e3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:28.041281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:28.042061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:28.042337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:28.042603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:28.043752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:28.045201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8610-4a21-432a-a4d7-570657cce891 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:28.046768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 575/1137] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:28.052535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:28.143917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de2cb1-3c35-45d9-840c-95b62f58622d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:28.175587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:28.176235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:28.176545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:28.176818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:28.177514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:28.178922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4d2e9-8359-4ac2-9611-9490935cd2b3 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:28.291993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 563/1138] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:07:28 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:07:30.595077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c046-488d-441a-9b29-51acf014491a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:30.595588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c046-488d-441a-9b29-51acf014491a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:30.595588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c046-488d-441a-9b29-51acf014491a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:30.596942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 576/1139] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:30.602075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:30.602483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:30.602622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:30.618566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:30.619766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:30.682293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 564/1140] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:30.705634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c046-488d-441a-9b29-51acf014491a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:30.799556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c046-488d-441a-9b29-51acf014491a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:30.831764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:30.832569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:30.832851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:30.833122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:30.843345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:30.851090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:30.852814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:30.853983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 577/1141] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:30.858627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:30.953229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2d0db-ee77-4ccc-af52-ca829aa5ae7d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:30.984717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bf52-b128-4957-b373-575727deaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:30.985365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bf52-b128-4957-b373-575727deaceb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:30.985644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bf52-b128-4957-b373-575727deaceb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:30.985917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bf52-b128-4957-b373-575727deaceb None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:30.986651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598bf52-b128-4957-b373-575727deaceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:30.986950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598bf52-b128-4957-b373-575727deaceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:30.988302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598bf52-b128-4957-b373-575727deaceb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:30.995856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 565/1142] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:31.001586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:31.095229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe48f92-8e04-47bb-a505-3176e09d96ac None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:31.126990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:31.127785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:31.128063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:31.128334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] PATH_INFO: `/v3/users/553cecf5ac094cd8a9e569739b85e9a8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:31.141314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] RBAC: Authorizing `identity:get_user(user_id=553cecf5ac094cd8a9e569739b85e9a8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:31.142742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:31.144338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 578/1143] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:31 2022] GET /identity/v3/users/553cecf5ac094cd8a9e569739b85e9a8 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:31.150418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bf52-b128-4957-b373-575727deaceb None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:31.242161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bf52-b128-4957-b373-575727deaceb None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:31.273130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:31.274299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:31.274575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:31.274846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:31.336662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:31.338086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:31.428332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 566/1144] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:31.434068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:31.527095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d366e-4213-4ee1-9e7d-5496057d0630 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:31.558781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:31.559615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:31.559895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:31.560166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] PATH_INFO: `/v3/projects/6a6b5ae86ce846a89fb24b283168db2e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:31.561341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6b5ae86ce846a89fb24b283168db2e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:31.562762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848a280-f30f-46a0-ac22-aa7c674bb894 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:31.564410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 579/1145] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:31 2022] GET /identity/v3/projects/6a6b5ae86ce846a89fb24b283168db2e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:31.570129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:31.660560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e2f0-e3f6-4923-a40f-46c07a67c485 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:31.692007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:31.692605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:31.692883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:31.693153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:31.693972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=6a6b5ae86ce846a89fb24b283168db2e, user.id=553cecf5ac094cd8a9e569739b85e9a8) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:31.694279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:31.696298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89544cc1-c346-400e-b3f8-c84a2e49ef8f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:31.701446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 567/1146] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:31 2022] GET /identity/v3/role_assignments?user.id=553cecf5ac094cd8a9e569739b85e9a8&scope.project.id=6a6b5ae86ce846a89fb24b283168db2e&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:33.912713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e675-3755-48bb-af77-b3a8f724bec2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:33.913231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e675-3755-48bb-af77-b3a8f724bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:33.913231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e675-3755-48bb-af77-b3a8f724bec2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:33.915174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 580/1147] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:33.920444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:33.920850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:33.920994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:33.937166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:33.938327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:34.000511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 568/1148] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:34.023156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e675-3755-48bb-af77-b3a8f724bec2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:34.118287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e675-3755-48bb-af77-b3a8f724bec2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:34.150254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:34.151028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:34.151309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:34.151582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:34.161097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:34.168845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:34.169896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:34.171000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 581/1149] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:34.176171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:34.267025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a4f7-a43c-40cc-8081-ef3cd14935d9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:34.298142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:34.298782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:34.299057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:34.299325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:34.300309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:34.300636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:34.301980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:34.309601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 569/1150] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:07:34.315633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:34.410405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4cd1-7e88-4af9-b7e3-159cb2d86b43 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:34.441479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:34.442285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:34.442564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:34.442837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] PATH_INFO: `/v3/users/553cecf5ac094cd8a9e569739b85e9a8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:34.444008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] RBAC: Authorizing `identity:get_user(user_id=553cecf5ac094cd8a9e569739b85e9a8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:34.445984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:34.447580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 582/1151] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:34 2022] GET /identity/v3/users/553cecf5ac094cd8a9e569739b85e9a8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:34.453779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:34.546253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281bf0-e82c-4ef1-b981-3c58e3e5716e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:34.578004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:34.578845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:34.579127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:34.579401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] PATH_INFO: `/v3/projects/6a6b5ae86ce846a89fb24b283168db2e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:34.580585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] RBAC: Authorizing `identity:get_project(project_id=6a6b5ae86ce846a89fb24b283168db2e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:34.582004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8b8bc-939e-4cd1-9dbc-b805cc7ab97b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:34.583653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 570/1152] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:34 2022] GET /identity/v3/projects/6a6b5ae86ce846a89fb24b283168db2e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:34.589215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:34.681640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c20d-c257-4ee4-a2e8-4fd1174bc173 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:34.712512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:34.713314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:34.713587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:34.713855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] PATH_INFO: `/v3/projects/6a6b5ae86ce846a89fb24b283168db2e/users/553cecf5ac094cd8a9e569739b85e9a8/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:34.715748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6b5ae86ce846a89fb24b283168db2e, user_id=553cecf5ac094cd8a9e569739b85e9a8, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:34.717176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e609d1f-2cf7-40d1-8b80-3ef856353960 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:34.787268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 583/1153] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:07:34 2022] PUT /identity/v3/projects/6a6b5ae86ce846a89fb24b283168db2e/users/553cecf5ac094cd8a9e569739b85e9a8/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:07:36.995138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd489a-bee8-4eda-bc6f-a7e96455644b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:36.995763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd489a-bee8-4eda-bc6f-a7e96455644b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:36.995763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd489a-bee8-4eda-bc6f-a7e96455644b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:36.997076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 571/1154] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:37.002258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.002707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.002806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.018898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:37.020071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:37.082192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 584/1155] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:37.105978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd489a-bee8-4eda-bc6f-a7e96455644b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:37.200109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd489a-bee8-4eda-bc6f-a7e96455644b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:37.231073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:37.231846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.232127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.232427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.242391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:37.250067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:37.251214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:37.252332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 572/1156] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:37.257055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:37.349368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc00d6-7169-43d6-928a-6abfdad5b962 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:37.381026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:37.381681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.381960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.382229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.383465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:37.383761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:37.385145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:37.392747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 585/1157] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:37.399825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:37.492808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa0be-773e-46b7-9dae-30379947aef0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:37.524714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:37.525506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.525782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.526051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] PATH_INFO: `/v3/users/553cecf5ac094cd8a9e569739b85e9a8` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.527221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] RBAC: Authorizing `identity:get_user(user_id=553cecf5ac094cd8a9e569739b85e9a8)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:37.528675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:37.530253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 573/1158] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/users/553cecf5ac094cd8a9e569739b85e9a8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:37.535813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:37.629306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38212608-e08b-4425-a065-5e9920fd53d9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:37.660232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:37.660893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.661169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.661437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.722948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:37.724391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:37.814853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 586/1159] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:37.821222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:37.912651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290b13-ed28-404c-bcc6-d7c07b61ee1e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:37.944886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:37.945746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:37.946027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:37.946300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] PATH_INFO: `/v3/projects/6a6b5ae86ce846a89fb24b283168db2e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:37.947465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6b5ae86ce846a89fb24b283168db2e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:37.948917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2fba3-6413-40e5-a670-ab03b6aed271 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:37.950583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 574/1160] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/projects/6a6b5ae86ce846a89fb24b283168db2e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:37.956551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:38.047631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b54e-8811-4595-9dd1-0a7623aab0d7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:38.080343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:38.080953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:38.081238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:38.081508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:38.082317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=6a6b5ae86ce846a89fb24b283168db2e, user.id=553cecf5ac094cd8a9e569739b85e9a8) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:38.082624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:38.084026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724249-d2a0-4d11-b8a3-835e72d7cf82 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:38.090030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 587/1161] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:37 2022] GET /identity/v3/role_assignments?user.id=553cecf5ac094cd8a9e569739b85e9a8&scope.project.id=6a6b5ae86ce846a89fb24b283168db2e&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:40.314312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67ae-0b2c-436b-b4d7-8846b225b3c4 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:40.314874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67ae-0b2c-436b-b4d7-8846b225b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:40.314874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67ae-0b2c-436b-b4d7-8846b225b3c4 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:40.316201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 575/1162] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:07:40.321751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:40.322127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:40.322304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:40.339100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:40.340261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:40.401917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 588/1163] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:40.423831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b67ae-0b2c-436b-b4d7-8846b225b3c4 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:40.517362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b67ae-0b2c-436b-b4d7-8846b225b3c4 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:40.548659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:40.549286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:40.549568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:40.550102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:40.611772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:40.613181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:40.703720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 576/1164] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:40.709681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:40.800778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b4e66-aeed-4d92-9508-f42d86c67996 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:40.832449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:40.833230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:40.833502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:40.833767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:40.840021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:40.841458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-de5ed64b-3778-4a43-a675-0c752383c766 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:40.854993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:40.856220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:40.857148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 589/1165] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:07:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:40.862065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:40.954559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a8c7-98be-4dd4-acd5-e4a04668b9c9 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:40.986029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:40.986671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:40.986954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:40.987230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:40.987940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:40.988243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:40.989630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea0b8f-f8f8-47e2-a7e3-57a6ec01b32b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:40.997046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 577/1166] 10.222.0.21 () {56 vars in 1115 bytes} [Tue May 3 12:07:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:43.196414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe862f-6c70-4044-9ced-14568c50ff3a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:43.196938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe862f-6c70-4044-9ced-14568c50ff3a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:43.196938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe862f-6c70-4044-9ced-14568c50ff3a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:43.198293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 590/1167] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:43.203342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f0467-312e-4767-b82b-90a745577239 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:43.203764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f0467-312e-4767-b82b-90a745577239 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:43.203900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f0467-312e-4767-b82b-90a745577239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:43.220591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-113f0467-312e-4767-b82b-90a745577239 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:43.221746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-113f0467-312e-4767-b82b-90a745577239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:43.283452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 578/1168] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:43.305795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe862f-6c70-4044-9ced-14568c50ff3a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:43.401625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe862f-6c70-4044-9ced-14568c50ff3a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:43.432434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:43.433074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:43.433353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:43.433625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:43.434354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:43.435699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7adf7-b49b-475a-827e-f86857842187 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:43.515453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 591/1169] 10.222.0.21 () {60 vars in 1138 bytes} [Tue May 3 12:07:43 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:07:45.788404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258830-c425-42e2-8d2a-b8cd6fba431e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:45.788933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258830-c425-42e2-8d2a-b8cd6fba431e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:45.788933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258830-c425-42e2-8d2a-b8cd6fba431e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:45.790264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 579/1170] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:45.795461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:45.795886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:45.796020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:45.812895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:45.814060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:45.875595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 592/1171] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:07:45.899316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258830-c425-42e2-8d2a-b8cd6fba431e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:45.993463 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258830-c425-42e2-8d2a-b8cd6fba431e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:46.024749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:46.025578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:46.025851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:46.026117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] PATH_INFO: `/v3/domains/484d1ae7cd634beda3d7bd4cbaa11768` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:46.035752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=484d1ae7cd634beda3d7bd4cbaa11768)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:46.037207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035c0df-d13e-4c8b-82d6-ac33f3efb3ef None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:46.038891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 580/1172] 10.222.0.21 () {56 vars in 1183 bytes} [Tue May 3 12:07:45 2022] GET /identity/v3/domains/484d1ae7cd634beda3d7bd4cbaa11768 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:46.044651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:46.136302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27daed-3417-4e3f-a110-b5a07263d3dd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:46.167871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:46.168540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:46.168824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:46.169097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:46.169801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:46.171217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b04650-dd9c-48e3-aa41-471b2bfda57f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:46.293003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 593/1173] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:07:46 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:07:48.540068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c8ac-3431-401d-930a-92eb6fe687c1 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:48.540684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c8ac-3431-401d-930a-92eb6fe687c1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:48.540684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c8ac-3431-401d-930a-92eb6fe687c1 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:48.541991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 581/1174] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:48.547173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:48.547565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:48.547732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:48.564295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:48.565512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:48.627435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 594/1175] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:48.652788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c8ac-3431-401d-930a-92eb6fe687c1 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:48.747619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c8ac-3431-401d-930a-92eb6fe687c1 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:48.779091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:48.779938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:48.780220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:48.780526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] PATH_INFO: `/v3/domains/484d1ae7cd634beda3d7bd4cbaa11768` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:48.781693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=484d1ae7cd634beda3d7bd4cbaa11768)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:48.783108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adacfa-2473-45eb-b78f-e43e6b7c9f45 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:48.784741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 582/1176] 10.222.0.21 () {56 vars in 1183 bytes} [Tue May 3 12:07:48 2022] GET /identity/v3/domains/484d1ae7cd634beda3d7bd4cbaa11768 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:48.791528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:48.884596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc7364-cec9-4ec5-9ffb-db078ab1bf45 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:48.915758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:48.916431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:48.916714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:48.916986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:48.917675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:48.919095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2b24-08f0-443e-b6cd-e8d83e4c1828 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:49.023795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 595/1177] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:07:48 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:07:51.281720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099e7d-49f5-4017-81d9-0e4045678d71 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.282285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099e7d-49f5-4017-81d9-0e4045678d71 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.282285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099e7d-49f5-4017-81d9-0e4045678d71 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:51.283629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 583/1178] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:51.288833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.289219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.289391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:51.306212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:51.307406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:51.370399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 596/1179] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:51.393929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2099e7d-49f5-4017-81d9-0e4045678d71 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:51.489079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2099e7d-49f5-4017-81d9-0e4045678d71 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:51.519978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:51.520780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.521061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.521330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:51.531251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:51.539399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:51.540713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:51.541908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 584/1180] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:51.546389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:51.637750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a11a-40e1-467f-ab97-07e3853802e5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:51.669942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:51.670592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.670872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.671141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:51.671911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:51.672206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:51.673600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:51.682225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 597/1181] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:51.688262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:51.782100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a656241-685a-4a91-a762-906f5c5f9d4a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:51.813231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:51.814075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.814347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.814611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] PATH_INFO: `/v3/users/2c522e96cb62444a98fa88416f4232ed` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:51.826574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] RBAC: Authorizing `identity:get_user(user_id=2c522e96cb62444a98fa88416f4232ed)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:51.827992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:51.829610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 585/1182] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:51 2022] GET /identity/v3/users/2c522e96cb62444a98fa88416f4232ed => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:51.835767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:51.928960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ed910-15ea-4a3b-916e-7384251bc90e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:51.959686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:51.960874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:51.961155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:51.961425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:52.025941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:52.027379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:52.118288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 598/1183] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:52.124057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:52.215373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab77d-449f-48ac-868d-95ede5058385 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:52.246420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:52.247243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:52.247517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:52.247784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] PATH_INFO: `/v3/projects/61b147790c424cbda06a24c4ef6ecd8d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:52.248943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=61b147790c424cbda06a24c4ef6ecd8d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:52.250334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fd020-3df8-420b-9c54-65c12e889ee7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:52.251947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 586/1184] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:52 2022] GET /identity/v3/projects/61b147790c424cbda06a24c4ef6ecd8d => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:52.258288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:52.351838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e342b0-c345-47bf-b147-0e36001c3b7e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:52.383909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:52.384526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:52.384809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:52.385081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:52.385897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=61b147790c424cbda06a24c4ef6ecd8d, user.id=2c522e96cb62444a98fa88416f4232ed) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:52.386206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:52.387624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed14428-7991-43ed-8b27-99d3a0982d83 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:52.392833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 599/1185] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:52 2022] GET /identity/v3/role_assignments?user.id=2c522e96cb62444a98fa88416f4232ed&scope.project.id=61b147790c424cbda06a24c4ef6ecd8d&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:54.577680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9aae2-4547-48e7-95e5-e8bc6e35d701 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:54.578206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9aae2-4547-48e7-95e5-e8bc6e35d701 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:54.578206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9aae2-4547-48e7-95e5-e8bc6e35d701 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:54.579570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 587/1186] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:54.584981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:54.585421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:54.585532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:54.602223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:54.603313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:54.664825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 600/1187] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:54.687798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9aae2-4547-48e7-95e5-e8bc6e35d701 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:54.782287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9aae2-4547-48e7-95e5-e8bc6e35d701 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:54.814405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:54.815187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:54.815464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:54.815734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:54.825312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:54.832846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:54.833918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:07:54.835521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 588/1188] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:54.843715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:54.937369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d224a2-b239-4316-847b-e91d254c47cb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:54.969482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:54.970141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:54.970419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:54.970691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:54.971422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:54.971723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:54.973110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:54.981396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 601/1189] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:54.987428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:55.079873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c57f5-45b5-41da-9277-27ef02e76bb2 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:55.113558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:55.114414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:55.114686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:55.114952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] PATH_INFO: `/v3/users/2c522e96cb62444a98fa88416f4232ed` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:55.116107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] RBAC: Authorizing `identity:get_user(user_id=2c522e96cb62444a98fa88416f4232ed)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:55.117673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:55.119270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 589/1190] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:54 2022] GET /identity/v3/users/2c522e96cb62444a98fa88416f4232ed => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:55.125586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:55.220303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ea21-a588-4ad6-8b6b-4968532b1276 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:55.251407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:55.252277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:55.252579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:55.252847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] PATH_INFO: `/v3/projects/61b147790c424cbda06a24c4ef6ecd8d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:55.254012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] RBAC: Authorizing `identity:get_project(project_id=61b147790c424cbda06a24c4ef6ecd8d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:55.255439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f3a96-7ff9-4c13-af49-79d4a999f566 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:55.257667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 602/1191] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:55 2022] GET /identity/v3/projects/61b147790c424cbda06a24c4ef6ecd8d => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:55.263506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:55.363852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737ab5-cbe8-42ed-86f9-e5f1272cda27 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:55.394909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:55.395777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:55.396053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:55.396322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] PATH_INFO: `/v3/projects/61b147790c424cbda06a24c4ef6ecd8d/users/2c522e96cb62444a98fa88416f4232ed/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:55.398971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=61b147790c424cbda06a24c4ef6ecd8d, user_id=2c522e96cb62444a98fa88416f4232ed, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:55.400424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5aa2e-6737-4376-acf7-89359b73b9c5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:55.485274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 590/1192] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:07:55 2022] PUT /identity/v3/projects/61b147790c424cbda06a24c4ef6ecd8d/users/2c522e96cb62444a98fa88416f4232ed/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:07:57.683941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c08b9-2c84-4ea2-a028-822da2e36214 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:57.684562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c08b9-2c84-4ea2-a028-822da2e36214 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:57.684562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c08b9-2c84-4ea2-a028-822da2e36214 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:57.685798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 603/1193] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:07:57.690902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:57.691289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:57.691464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:57.708007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:07:57.709213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:07:57.776510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 591/1194] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:07:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:07:57.799919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c08b9-2c84-4ea2-a028-822da2e36214 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:57.893411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c08b9-2c84-4ea2-a028-822da2e36214 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:57.923652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:57.924701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:57.924987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:57.925255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:57.935685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:07:57.943213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:07:57.945002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:07:57.945935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 604/1195] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:07:57.950683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:58.041256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820cec1-7e20-41c2-9c03-59d2feb191c2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:58.073457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:58.074108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:58.074390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:58.074665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:58.075402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:58.075706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:58.077095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:58.084696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 592/1196] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:58.090337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:58.182119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd785d2-f24a-40af-948a-ab56569125df None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:58.212785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:58.213576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:58.213855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:58.214124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] PATH_INFO: `/v3/users/2c522e96cb62444a98fa88416f4232ed` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:58.215271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] RBAC: Authorizing `identity:get_user(user_id=2c522e96cb62444a98fa88416f4232ed)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:58.216700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:58.218253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 605/1197] 10.222.0.21 () {56 vars in 1177 bytes} [Tue May 3 12:07:58 2022] GET /identity/v3/users/2c522e96cb62444a98fa88416f4232ed => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:58.223708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:58.317000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1f9b-f039-49a4-9437-a9fe3c4c85e4 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:58.351245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:58.351245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:58.351245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:58.351245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:58.411671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:58.413635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:58.503406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 593/1198] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:07:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:07:58.509229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:58.602056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5900-63ab-411d-bede-c0fe1f8da851 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:58.632695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:58.633530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:58.633806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:58.634078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] PATH_INFO: `/v3/projects/61b147790c424cbda06a24c4ef6ecd8d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:58.635227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] RBAC: Authorizing `identity:get_project(project_id=61b147790c424cbda06a24c4ef6ecd8d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:58.636659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635622da-9ac6-4e66-a7b9-e67b90b0c78b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:58.638297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 606/1199] 10.222.0.21 () {56 vars in 1186 bytes} [Tue May 3 12:07:58 2022] GET /identity/v3/projects/61b147790c424cbda06a24c4ef6ecd8d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:07:58.644103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:07:58.735747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d9d8-aad0-4e97-b3b6-a89b53ac4d97 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:07:58.766587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:07:58.767161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:07:58.767440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:07:58.767713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:07:58.768552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=61b147790c424cbda06a24c4ef6ecd8d, user.id=2c522e96cb62444a98fa88416f4232ed) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:07:58.768861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:07:58.770256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafcd89-f44a-4082-95e3-e110da7eb120 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:07:58.776220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 594/1200] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:07:58 2022] GET /identity/v3/role_assignments?user.id=2c522e96cb62444a98fa88416f4232ed&scope.project.id=61b147790c424cbda06a24c4ef6ecd8d&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:15.024442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493fdc-7366-4df5-b177-6dd779fd290c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:15.025033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493fdc-7366-4df5-b177-6dd779fd290c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:15.025033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493fdc-7366-4df5-b177-6dd779fd290c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:15.026313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 607/1201] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:15.031382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401455-7782-43c2-8177-217810011b3c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:15.035975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401455-7782-43c2-8177-217810011b3c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:15.035975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401455-7782-43c2-8177-217810011b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:15.048380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ee401455-7782-43c2-8177-217810011b3c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:15.049548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ee401455-7782-43c2-8177-217810011b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:15.111978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 595/1202] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:15.137180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493fdc-7366-4df5-b177-6dd779fd290c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:15.231637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493fdc-7366-4df5-b177-6dd779fd290c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:15.263386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:15.264158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:15.264461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:15.264731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:15.274193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:15.284625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:15.292554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:15.293703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:15.294723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:15.294723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:15.294723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:15.294723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:15.294723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 608/1203] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:15.299996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401455-7782-43c2-8177-217810011b3c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:15.399158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401455-7782-43c2-8177-217810011b3c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:15.432076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:15.432763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:15.433040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:15.433310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:15.434021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:15.434320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:15.435665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cfb6-3cab-4ff7-a985-f1c40a0c6e5c None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:15.446304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 596/1204] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:15.452169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:15.549240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c0125-847f-442a-8c9f-c548cdc52f7a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:15.581192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:15.581845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:15.582123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:15.582391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:15.583068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:15.584639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9186bb-4ef1-4bbc-a586-637ffb2913fb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:15.671231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 609/1205] 10.222.0.21 () {60 vars in 1132 bytes} [Tue May 3 12:09:15 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:09:17.969355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e41b-ea06-4ecf-93c4-663a7bd3a121 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:17.969887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e41b-ea06-4ecf-93c4-663a7bd3a121 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:17.969887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322e41b-ea06-4ecf-93c4-663a7bd3a121 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:17.971271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 597/1206] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:17.977159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:17.977558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:17.977702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:17.993709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:17.994868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:18.057813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 610/1207] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:18.080851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322e41b-ea06-4ecf-93c4-663a7bd3a121 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.178637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322e41b-ea06-4ecf-93c4-663a7bd3a121 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.210236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.211019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.211296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.211565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.222274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:18.230425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:18.231606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:18.232653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:18.236616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 598/1208] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:18.237932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.330636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3984d0a-764d-442e-becf-7f45ce269cff None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.363417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.364065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.364338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.364634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.365359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:18.365657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:18.367084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:18.374611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 611/1209] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:18.381071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.476183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662ea6-96d2-4ff3-a61b-257014ff3ce0 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.508162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.508969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.509247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.509517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.519127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:18.520609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:18.537995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:18.539055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:18.539992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:18.539992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:18.539992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:18.539992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:18.539992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 599/1210] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:18.545053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.639474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a78e0-af6e-4424-9424-d4dfe5568b8f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.671012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.671661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.671941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.672207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.673194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:18.673495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:18.674851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:18.686675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 612/1211] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:18.692425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.785884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1869fa-4bd1-447a-818e-37643725ebcf None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.817120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.817911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.818256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.818564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.825523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:18.826943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:18.841360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:18.843932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:18.845143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 600/1212] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:09:18.849099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:18.944130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e103-80ca-42db-9944-869128de22e9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:18.976778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:18.977433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:18.977981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:18.977981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:18.978773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:18.979076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:18.980517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:18.996885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 613/1213] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:09:19.002595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.095426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be55a-af1b-4604-a6ad-a331ae884f1b None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:19.126572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:19.127201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:19.127483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:19.127756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:19.190449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:19.191870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:19.282723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 601/1214] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:09:19.288518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.383927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57487b69-b531-4178-9211-9b3fa805df0a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:19.415374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:19.416145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:19.416452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:19.416718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:19.426263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:19.428181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:19.445587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:19.446728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:19.447835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:19.447835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:19.447835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:19.447835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:19.447835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 614/1215] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:09:19.452496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.547218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11521-4c05-41b6-b319-d4191179d97a None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:19.579269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:19.579918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:19.580194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:19.580492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:19.581198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:19.581495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:19.582835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:19.593868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 602/1216] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:19.600207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.694788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd809-cc38-4f46-bc20-5c121a381967 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:19.727020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:19.727790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:19.728065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:19.728333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:19.734680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:19.736098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:19.749635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:19.750597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:19.751903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 615/1217] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:19.756755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.850509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec878612-3226-4b0a-809f-6b8df8033204 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:19.881647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:19.882294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:19.882574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:19.882845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:19.883622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:19.883928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:19.885380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947cb2-9240-4aaa-8d19-57fc6568cb02 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:19.897233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 603/1218] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:19.903255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:19.995070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37932-558e-4078-9f30-1ce3d9ecd8ad None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:20.026799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:20.033348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:20.033738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:20.034211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:20.035060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8536acd053b44e48493e68622d82d39) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:20.035372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:20.036883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30bad6-1dbe-4acd-b463-6c16b716731c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:20.042312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 616/1219] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:09:19 2022] GET /identity/v3/role_assignments?user.id=f8536acd053b44e48493e68622d82d39&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:09:22.245865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1295-25ad-47e4-ae71-161c27e4ecd1 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.246417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1295-25ad-47e4-ae71-161c27e4ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.246417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1295-25ad-47e4-ae71-161c27e4ecd1 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.247767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 604/1220] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:22.253042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.253469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.253596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.270251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:22.278244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:22.334321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 617/1221] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:22.356145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1295-25ad-47e4-ae71-161c27e4ecd1 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:22.451640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1295-25ad-47e4-ae71-161c27e4ecd1 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:22.482790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:22.483578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.483855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.484129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.494240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:22.503929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:22.505240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:22.506859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 605/1222] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:22.509844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:22.602336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dcf0f-a767-4c65-af54-390bef88afb3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:22.635127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:22.635808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.636084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.636348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.637126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:22.637420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:22.638774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:22.646398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 618/1223] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:22.653747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:22.747918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889ee1f-a695-4455-9112-41524dccd171 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:22.781577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:22.782350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.782626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.782892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.793435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:22.794854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:22.811960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:22.813116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:22.814392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:22.814392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:22.814392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:22.814392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:22.814392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 606/1224] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:22.819003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:22.915088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e910-20a4-4420-b12e-3f6937bd3bf5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:22.947167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:22.947815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:22.948096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:22.948391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:22.949107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:22.949455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:22.950814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:22.962774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 619/1225] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:22.968252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.060750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33518-4933-473d-9e92-0f43689802bf None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.092237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.093093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.093365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.101480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.102902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:23.116903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:23.118047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:23.119444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 607/1226] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:23.123871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.219285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228a4-8b7f-46d6-b7a0-5867dc589927 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.250646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.251293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.251568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.251835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.252723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:23.257869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.257869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.270902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 620/1227] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:09:23.276563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.371430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb5bb-d268-4323-9f31-7b7cdcd66f6d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.403160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.403939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.404218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.404521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.414598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.416022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:23.433239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:23.434221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:23.435163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:23.435163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:23.435163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:23.435163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:23.435163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 608/1228] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:23.440156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.532373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a014-d83b-4aad-a204-2dd85899f477 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.565695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.566361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.566647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.566896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.567599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:23.567923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.569306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.580243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 621/1229] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:23.585934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.681538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c09af-40e8-4a35-adb1-1b917c90daf5 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.712189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.712998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.713279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.713553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.719885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.721339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:23.735411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:23.736512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:23.745437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 609/1230] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:23.746024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.843281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d224a7-1eec-466c-9fa1-914f5ff4ac5d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:23.875131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:23.875846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:23.876126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:23.876421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:23.877196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:23.877502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:23.878922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ba74-7e63-422f-9c7d-43778c7c2f69 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:23.890269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 622/1231] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:23.896272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:23.991700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677440d6-c378-448d-97ad-b0f808c187cd None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:24.023804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:24.024698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:24.025019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:24.025295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8536acd053b44e48493e68622d82d39/roles/fa5ca85591f848e8aed4fe0379e0dd27` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:24.039293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=f8536acd053b44e48493e68622d82d39, role_id=fa5ca85591f848e8aed4fe0379e0dd27)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:24.040763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb777-1d2c-4817-a4e4-0be76ff56717 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:24.155995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 610/1232] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:09:23 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8536acd053b44e48493e68622d82d39/roles/fa5ca85591f848e8aed4fe0379e0dd27 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:09:26.382201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089109b-e345-4f3f-88fc-619113847c28 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:26.382698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089109b-e345-4f3f-88fc-619113847c28 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:26.382790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089109b-e345-4f3f-88fc-619113847c28 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:26.384195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 623/1233] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:26.389350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:26.389766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:26.389882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:26.405534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:26.406791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:26.468751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 611/1234] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:26.492565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089109b-e345-4f3f-88fc-619113847c28 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:26.588957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089109b-e345-4f3f-88fc-619113847c28 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:26.621941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:26.622672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:26.622951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:26.623222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:26.633641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:26.641661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:26.642780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:26.643747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 624/1235] 10.222.0.21 () {56 vars in 1102 bytes} [Tue May 3 12:09:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:26.649378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:26.743511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80653a4-b4d7-4bfa-8dee-c2f69e768a9a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:26.775481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:26.776134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:26.776436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:26.776731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:26.777462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:26.777766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:26.779168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:26.787156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 612/1236] 10.222.0.21 () {56 vars in 1103 bytes} [Tue May 3 12:09:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:26.792814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:26.888905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a156-a5e6-4a9b-99b5-66640cca95f1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:26.920025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:26.920861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:26.921159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:26.921428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:26.932228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:26.933678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:26.950537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:26.951553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:26.952547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:26.952547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:26.952547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:26.952547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:26.952547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 625/1237] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:26.957474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.050214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb441084-2491-4dd6-95ed-3b648dab00fc None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.082435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.083106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.083386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.083656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.084383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:27.084690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.086036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:27.096580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 613/1238] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:27.102267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.197531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3724fb-7918-4860-89e9-ba72eff65f5a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.228593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.232189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.232189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.232189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.237057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.238558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:27.252919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:27.253978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:27.255986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 626/1239] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:27.260503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.353910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db053-a9a1-49da-987b-f806aa8b561e None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.386044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.386731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.387010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.387286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.388117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:27.388451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.389952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:27.406468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 614/1240] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:27.412857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.507339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079361b-ba87-4865-8ac9-e0182a4c0bb4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.539223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.539855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.540130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.540447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.603690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.605157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:27.697169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 627/1241] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:09:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:09:27.703065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.796731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dd0db-8a47-4593-b756-bf49a731c0de None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.828247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.829075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.829352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.829638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.839506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.841406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:27.858532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:27.859626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:27.860670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:27.860670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:27.860670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:27.860670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:27.860670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 615/1242] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:27.865405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:27.957259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6524-6ede-48b3-9ebe-fee4f23a1c60 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:27.990772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:27.991420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:27.991708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:27.991978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:27.992712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:27.993014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:27.994370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:28.005247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 628/1243] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:28.010982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:28.111795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7ac7-e711-44ed-99f0-657cdcc9fe36 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:28.144064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:28.144879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:28.145157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:28.145427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:28.152406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:28.153846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:28.167084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:28.168165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:28.173642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 616/1244] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:28.174455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:28.268174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169247-5242-4b5d-a6be-2ea5c648caad None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:28.300172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:28.300844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:28.301121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:28.301388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:28.302151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:28.302449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:28.303878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cdf7-2e29-46cc-8e70-64e685060402 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:28.315523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 629/1245] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:28.322118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:28.418279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a2a3a-5d43-40ce-83e4-df824557ada7 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:28.449982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:28.450623 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:28.450900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:28.451173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:28.451996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] RBAC: Adding query filter params (role.id=fa5ca85591f848e8aed4fe0379e0dd27, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8536acd053b44e48493e68622d82d39) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:28.452303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:28.453742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b683f-76c6-4095-881f-8dba1d6c8656 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:28.459283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 617/1246] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:09:28 2022] GET /identity/v3/role_assignments?user.id=f8536acd053b44e48493e68622d82d39&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=fa5ca85591f848e8aed4fe0379e0dd27 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:30.763764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2de7-0cee-4706-a963-493b24074fc8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:30.764335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2de7-0cee-4706-a963-493b24074fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:30.764335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2de7-0cee-4706-a963-493b24074fc8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:30.765658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 630/1247] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:30.770825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:30.771270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:30.771373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:30.787450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:30.788641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:30.852355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 618/1248] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 12:09:30.876243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2de7-0cee-4706-a963-493b24074fc8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:30.972089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2de7-0cee-4706-a963-493b24074fc8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.003777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.004609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.004895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.005168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.018876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:31.023556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:31.024751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:31.025993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 631/1249] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:31.030666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.125900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748f884-1755-47d3-ab28-0fdcb7383707 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.157642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.158303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.158583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.158856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.159592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:31.159895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.161285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:31.169534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 619/1250] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:31.175603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.270894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708bbe-6adc-48fb-9ac1-60e8a172ca56 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.303710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.304530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.304843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.305255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.315472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.316975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:31.333590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:31.334749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:31.335669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:31.335669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:31.335669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:31.335669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:31.335669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 632/1251] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:31.340774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.435911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc98fb-9b28-44bf-ba17-9b4ed54a3502 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.466994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.467646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.467924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.468195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.468935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:31.469235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.471984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:31.482304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 620/1252] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:31.487996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.583392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1ab5-c6be-41c0-b681-42b5f61b8d22 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.617207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.617993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.618268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.618638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.625776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.627175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:31.641441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:31.642572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:31.643751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 633/1253] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:31.648990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.741493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c1a3a-a5f2-4a65-8391-a5fa84aa0158 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.772728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.773388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.773667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.773937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.774756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:31.775059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.776489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:31.792832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 621/1254] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:31.798779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:31.894529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc699c-4f0b-4606-bd7d-e982aeb8ed34 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:31.926294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:31.926928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:31.927208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:31.927518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:31.990553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:31.991987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.084886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 634/1255] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:09:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:09:32.090905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:32.185524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7476-c421-4ef2-9214-d5d7ece08a6f None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:32.217183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:32.217958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:32.218238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:32.218509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:32.227917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:32.229388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:32.246750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:32.247856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:32.248991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:32.248991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:32.248991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:32.248991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:32.248991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 622/1256] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:32.253734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:32.346991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2767-a2a0-440e-9654-67ff914dba81 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:32.379184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:32.379902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:32.380188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:32.380515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:32.381762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:32.382063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:32.383472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.394102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 635/1257] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:32.399824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:32.500621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a489-a75d-45cd-86e5-35840bc5d88d None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:32.532726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:32.533511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:32.533786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:32.534054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:32.540989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:32.547742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:32.556460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:32.557489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:32.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 623/1258] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:32.563473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:32.657345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb012b96-b4c4-4c8e-9120-c9291696b3bd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:32.690947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:32.691723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:32.692000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:32.692286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:32.693132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:32.693442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:32.694855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f14c9-4c18-4670-ad9f-d58bb74bf6cb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.706448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 636/1259] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:32.712752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:32.808911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc7e2-c052-4a90-990c-0aecd807dd02 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:32.841152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:32.841791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:32.842067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:32.842335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:32.843140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8536acd053b44e48493e68622d82d39) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:32.843442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:32.844880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e39141-cb2d-47ae-a502-2920c519a1fa None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:32.850065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 624/1260] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:09:32 2022] GET /identity/v3/role_assignments?user.id=f8536acd053b44e48493e68622d82d39&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:35.055357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b37015-35ff-4467-be52-f2542ed2f918 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.055939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b37015-35ff-4467-be52-f2542ed2f918 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.055939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b37015-35ff-4467-be52-f2542ed2f918 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.057306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 637/1261] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:35.062609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.062991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.063165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.079803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:35.081098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:35.142980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 625/1262] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:35.166633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b37015-35ff-4467-be52-f2542ed2f918 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:35.262720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b37015-35ff-4467-be52-f2542ed2f918 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:35.296340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:35.297144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.297706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.297977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.307715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:35.315649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:35.316781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:35.324068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 638/1263] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:35.324989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:35.422521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bab44-c345-4342-870e-bf63319d44f6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:35.455767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:35.456456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.456741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.457015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.457757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:35.458056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:35.459933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:35.467878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 626/1264] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:35.474706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:35.568602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58e3-3d1f-4be2-b542-6040546200d1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:35.600322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:35.601180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.601461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.601733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.611701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:35.613158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:35.629516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:35.632129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:35.633112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:35.633112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:35.633112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:35.633112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:35.633112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 639/1265] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:35.637260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:35.744350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ea73-c936-4718-986c-8fb330a84656 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:35.778066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:35.778718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.778993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.779262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.779971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:35.780269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:35.781645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:35.792945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 627/1266] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:35.799045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:35.893778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901df8a-bd11-42fe-bd11-59ff8d464bd5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:35.925509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:35.926895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:35.926895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:35.926895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:35.934328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:35.935758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:35.950143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:35.951242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:35.952562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 640/1267] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:35.957200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.050534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4dd8-5c14-49a9-8bb5-e1362629a890 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.084321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.085015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.085294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.085568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.086455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:36.086757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.088188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:36.105427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 628/1268] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:36.111122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.211849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaa498-63f4-4240-9a5c-02073394a4f0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.243843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.244658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.244982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.245313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.256025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.257555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:36.273899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:36.274947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:36.275878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:36.275878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:36.275878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:36.275878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:36.275878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 641/1269] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:36.280919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.377653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8818a-9597-4750-9acb-486ca002eccf None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.408604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.409254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.409544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.409805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.410510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:36.410808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.412954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:36.425482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 629/1270] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:36.431775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.525204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8003-ee2f-4237-8d78-10e1d3876158 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.557834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.558619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.558901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.559175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.565549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.566995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:36.580878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:36.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:36.582842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 642/1271] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:36.588076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.683984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8be9-a041-49d8-9e2f-7cb8da4d1cc1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.715232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.715881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.716163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.716467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.717247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:36.717555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.718965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d28c-9a20-4ed6-b95c-cd46f2a561ca None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:36.731244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 630/1272] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:36.737385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:36.859196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c38b2-efcd-453c-8f8e-cd00ab9e38ed None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:36.892643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:36.893527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:36.893807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:36.894082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] PATH_INFO: `/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8536acd053b44e48493e68622d82d39/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:36.896575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b51b9eb70df40c4af8fde5ab24ad2f6, user_id=f8536acd053b44e48493e68622d82d39, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:36.902195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ace829-4570-442a-bcb7-a29201298606 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:37.046666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 643/1273] 10.222.0.21 () {58 vars in 1439 bytes} [Tue May 3 12:09:36 2022] PUT /identity/v3/projects/4b51b9eb70df40c4af8fde5ab24ad2f6/users/f8536acd053b44e48493e68622d82d39/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:09:39.246690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339a45-88a0-44a6-9cd3-d5f98a82810b None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.247268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339a45-88a0-44a6-9cd3-d5f98a82810b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.247268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339a45-88a0-44a6-9cd3-d5f98a82810b None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.248647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 631/1274] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:39.254175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.254175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.254674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.271267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:39.272501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:39.336034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 644/1275] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:39.359818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339a45-88a0-44a6-9cd3-d5f98a82810b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:39.458207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339a45-88a0-44a6-9cd3-d5f98a82810b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:39.490493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:39.491276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.491558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.491831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.501475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 12:09:39.509444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:39.510379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:39.511215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 632/1276] 10.222.0.21 () {56 vars in 1096 bytes} [Tue May 3 12:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:39.516793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:39.609726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220738e-9c27-4772-8a9b-25254f5f2260 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:39.645673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:39.646937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.647311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.647587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.648396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:39.648697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:39.650092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:39.664092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 645/1277] 10.222.0.21 () {56 vars in 1099 bytes} [Tue May 3 12:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:39.665369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:39.770055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9e77d-8323-4830-ba22-383d14550342 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:39.805137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:39.805966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.806225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.806497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.818348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:39.819844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:39.837869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:39.838928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:39.840115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:39.840115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:39.840115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:39.840115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:39.840115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 633/1278] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:39.845103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:39.947849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149128b7-c000-4b50-9712-cec5d057d3b8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:39.982415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:39.983086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:39.983367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:39.983642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:39.984353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:39.984683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:39.986075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:39.997727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 646/1279] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:40.003562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:40.104674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062aab9-19e1-4870-86c8-b6672670f1c1 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:40.137423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:40.138233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:40.138509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:40.138783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:40.146535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:40.147964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 12:09:40.161802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:40.162911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:40.164285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 634/1280] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:40.168791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:40.261311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10203-1531-4d8d-9ced-59d2c6b1fba3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:40.292835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51660-3742-423c-910d-982148025455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:40.293490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51660-3742-423c-910d-982148025455 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:40.293771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51660-3742-423c-910d-982148025455 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:40.294043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51660-3742-423c-910d-982148025455 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:40.294857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51660-3742-423c-910d-982148025455 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:40.295161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51660-3742-423c-910d-982148025455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:40.296597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51660-3742-423c-910d-982148025455 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:40.313006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 647/1281] 10.222.0.21 () {56 vars in 1143 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:40.319151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:40.415023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e64a6-e10b-420d-870e-287ef8d0e646 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:40.447362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:40.447998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:40.448277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:40.448576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:40.510408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:40.511831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:40.602151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 635/1282] 10.222.0.21 () {58 vars in 1282 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 12:09:40.608086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51660-3742-423c-910d-982148025455 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:40.702431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51660-3742-423c-910d-982148025455 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:40.733599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:40.734401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:40.734680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:40.734970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:40.745147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:40.746571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 12:09:40.763918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:40.764881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:40.765834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 12:09:40.765834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 12:09:40.765834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 12:09:40.765834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:40.765834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 648/1283] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 12:09:40.771052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:40.864302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c7664-ef2f-40c0-ac32-db44129ece08 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:40.897959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:40.898610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:40.898892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:40.899164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:40.899873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:40.900172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:40.901554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:40.912183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 636/1284] 10.222.0.21 () {56 vars in 1109 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:40.918015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:41.011949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a701f1-37b8-411b-84f5-924d7c88ef8e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:41.043350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:41.044117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:41.044418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:41.044692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:41.051209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:41.052759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 12:09:41.065997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:41.067016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: ERROR keystone.server.flask.application May 03 12:09:41.068693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 649/1285] 10.222.0.21 () {56 vars in 1111 bytes} [Tue May 3 12:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:41.073458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:41.166428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2467c-6ee4-4f0c-98b4-047c3a3efd56 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:41.198575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:41.199211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:41.199487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:41.199763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:41.200608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:41.200911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:41.202308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b371700-75ad-427b-9ef9-b7f7fb11b033 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:41.213545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 637/1286] 10.222.0.21 () {56 vars in 1148 bytes} [Tue May 3 12:09:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:41.219577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:41.314195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38cf86-28a8-4ae1-b82b-c8946fbe9102 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:41.345903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:41.346549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:41.346828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:41.347099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:41.347939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] RBAC: Adding query filter params (role.id=6b7c1849f40a4c4e9ed4147d19451458, scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6, user.id=f8536acd053b44e48493e68622d82d39) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:41.348244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:41.349693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f901ed-ea4a-48c1-b6eb-742fcb63e7ac None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:41.355411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 650/1287] 10.222.0.21 () {56 vars in 1374 bytes} [Tue May 3 12:09:41 2022] GET /identity/v3/role_assignments?user.id=f8536acd053b44e48493e68622d82d39&scope.project.id=4b51b9eb70df40c4af8fde5ab24ad2f6&role.id=6b7c1849f40a4c4e9ed4147d19451458 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:43.594741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5bbe-0848-429d-9e56-306433ea8689 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:43.595340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5bbe-0848-429d-9e56-306433ea8689 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:43.595340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b5bbe-0848-429d-9e56-306433ea8689 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:43.596646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 638/1288] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:43.602438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:43.602819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:43.602991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:43.619709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:43.620906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:43.683722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 651/1289] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:43.706012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b5bbe-0848-429d-9e56-306433ea8689 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:43.799818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b5bbe-0848-429d-9e56-306433ea8689 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:43.831038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:43.831813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:43.832091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:43.832373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:43.833044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:43.834490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:43.845864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:43.847069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:43.848135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 639/1290] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:09:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:43.855877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:43.948474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff2c5-d642-4cb8-9414-0731694b12c0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:43.979935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:43.980613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:43.980893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:43.981164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:43.981860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:43.982179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:43.983511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5789-77be-4b1f-bf42-bb299e489a16 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:43.988069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 652/1291] 10.222.0.21 () {56 vars in 1116 bytes} [Tue May 3 12:09:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:43.994566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:44.087725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88a36-ff66-4ce1-8d00-94e8b0306cfb None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:44.119786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:44.120382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:44.120677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:44.120949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] PATH_INFO: `/v3/services` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:44.121642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:44.121935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:44.123279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020819e-3128-4189-940c-cfa355c15747 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:44.127552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 640/1292] 10.222.0.21 () {56 vars in 1116 bytes} [Tue May 3 12:09:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:46.327288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5cad3-2114-4eaf-a20e-fd0c3ef38840 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:46.327825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5cad3-2114-4eaf-a20e-fd0c3ef38840 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:46.327825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5cad3-2114-4eaf-a20e-fd0c3ef38840 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:46.329229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 653/1293] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:46.335115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd197a-e6a6-455f-8d24-e2bd0066b67a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:46.335545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd197a-e6a6-455f-8d24-e2bd0066b67a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:46.335665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd197a-e6a6-455f-8d24-e2bd0066b67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:46.351991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-90fd197a-e6a6-455f-8d24-e2bd0066b67a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:46.355694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-90fd197a-e6a6-455f-8d24-e2bd0066b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:46.416233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 641/1294] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:46.439688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5cad3-2114-4eaf-a20e-fd0c3ef38840 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:46.535254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5cad3-2114-4eaf-a20e-fd0c3ef38840 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:46.568635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50711288-a510-4138-a127-fe73e27f719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:46.569279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711288-a510-4138-a127-fe73e27f719c None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:46.569559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711288-a510-4138-a127-fe73e27f719c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:46.569831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711288-a510-4138-a127-fe73e27f719c None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:46.570631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50711288-a510-4138-a127-fe73e27f719c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:46.571982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50711288-a510-4138-a127-fe73e27f719c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:46.618888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 654/1295] 10.222.0.21 () {60 vars in 1141 bytes} [Tue May 3 12:09:46 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:09:48.830925 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203fc7-5f9f-41b4-b5b6-1b874e9c9fe0 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:48.831486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203fc7-5f9f-41b4-b5b6-1b874e9c9fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:48.831486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203fc7-5f9f-41b4-b5b6-1b874e9c9fe0 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:48.833444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 642/1296] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:09:48.838443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:48.838881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:48.838984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:48.855921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:48.857155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:48.926193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 655/1297] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:48.948683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db203fc7-5f9f-41b4-b5b6-1b874e9c9fe0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:49.044238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db203fc7-5f9f-41b4-b5b6-1b874e9c9fe0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:49.077023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:49.077809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:49.078091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:49.078366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] PATH_INFO: `/v3/services/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:49.079017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:49.080398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:49.092480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:49.093631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:49.094644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 643/1298] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:09:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:49.099507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:49.191891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9e489-323c-4f2a-9e88-fa0e32f91fa8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:49.224686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:49.225336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:49.225615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:49.225886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:49.226579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:49.226881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:49.228246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:49.233187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 656/1299] 10.222.0.21 () {56 vars in 1116 bytes} [Tue May 3 12:09:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:49.239154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:49.334618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf33ea-84fe-425a-8dc2-1d8569f09aed None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:49.366047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:49.366697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:49.366982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:49.367258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:49.368039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] RBAC: Adding query filter params (interface=public, service_id=b72bb0a9ddb544b8913a3a0fe6c32ba6, region_id=RegionOne) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:49.368347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:49.369728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368fa1b-d478-401a-9773-4754a3fdc5f9 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:49.374533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 644/1300] 10.222.0.21 () {56 vars in 1251 bytes} [Tue May 3 12:09:49 2022] GET /identity/v3/endpoints?service_id=b72bb0a9ddb544b8913a3a0fe6c32ba6&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:49.381493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:49.475787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb56d-ae9e-49f0-889d-6dd1caca235c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:49.508442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:49.509097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:49.509380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:49.509656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:49.510321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:49.511677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d01e6e-ea61-4570-a576-786c0068d18e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:49.518166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 657/1301] 10.222.0.21 () {56 vars in 1087 bytes} [Tue May 3 12:09:49 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:09:51.758297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccbd5-0c6a-42d0-a20b-47744d0ddf84 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:51.758811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccbd5-0c6a-42d0-a20b-47744d0ddf84 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:51.758811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccbd5-0c6a-42d0-a20b-47744d0ddf84 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:51.760144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 645/1302] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:09:51.766688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:51.767182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:51.767346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:51.784593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:09:51.786403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:09:51.850299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 658/1303] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:09:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 12:09:51.873177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ccbd5-0c6a-42d0-a20b-47744d0ddf84 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:51.968552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ccbd5-0c6a-42d0-a20b-47744d0ddf84 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:52.000117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:52.000931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:52.001213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:52.001486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:52.002127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:52.003476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 12:09:52.015086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 12:09:52.016328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.get_or_create( May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application with Lock( May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self._enter() May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application return self.creator() May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application created_value = creator( May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: ERROR keystone.server.flask.application May 03 12:09:52.017386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 646/1304] 10.222.0.21 () {56 vars in 1117 bytes} [Tue May 3 12:09:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 12:09:52.022688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:52.117477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb1a08-48ba-49f5-ac8a-cc91575fb745 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:52.160059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:52.160781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:52.161062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:52.161391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:52.162092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:09:52.162425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:52.163847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fb5ac-32c8-46b4-9823-f60a41adec79 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:52.168889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 659/1305] 10.222.0.21 () {56 vars in 1116 bytes} [Tue May 3 12:09:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:09:52.175018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:09:52.269345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6e2b-1399-4712-8d8c-a75cbb795268 None admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:09:52.300871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:09:52.301542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:09:52.301824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:09:52.302098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:09:52.302822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:09:52.304177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f6f20-4755-4cfd-9de0-00508de491ff None admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:09:52.412557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 647/1306] 10.222.0.21 () {60 vars in 1144 bytes} [Tue May 3 12:09:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:15:53.624484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc745f-a2d1-485d-aaea-a4d487fe95c1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:53.625027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc745f-a2d1-485d-aaea-a4d487fe95c1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:53.625027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc745f-a2d1-485d-aaea-a4d487fe95c1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:53.626310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 660/1307] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:15:53.631548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf58815-29ca-45c3-b99f-c2bca356dc5c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:53.631974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf58815-29ca-45c3-b99f-c2bca356dc5c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:53.632111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf58815-29ca-45c3-b99f-c2bca356dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:53.712015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8bf58815-29ca-45c3-b99f-c2bca356dc5c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:15:53.713597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8bf58815-29ca-45c3-b99f-c2bca356dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:53.964930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 648/1308] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:15:54.011924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:54.012230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:54.012680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:54.014503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 661/1309] 10.222.0.21 () {54 vars in 964 bytes} [Tue May 3 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:15:54.021788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d2cf-f601-4a0c-8464-3b2062b8a65d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:54.030485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d2cf-f601-4a0c-8464-3b2062b8a65d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:54.030485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d2cf-f601-4a0c-8464-3b2062b8a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:54.097983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-17e7d2cf-f601-4a0c-8464-3b2062b8a65d None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:15:54.099170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-17e7d2cf-f601-4a0c-8464-3b2062b8a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:54.173739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 649/1310] 10.222.0.21 () {58 vars in 1061 bytes} [Tue May 3 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:15:54.182913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:15:54.184756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:54.292173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469083d3-6f54-4e18-ae19-e9316ec34557 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:15:54.367337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:15:54.367986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:54.371511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:54.371511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:54.371511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:54.484837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:15:54.486674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a124cce-3947-4f18-b314-91a05d5159db service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:15:54.508381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 662/1311] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:15:57.033551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:57.034055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:57.034159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:57.035513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 650/1312] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:15:57.040768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9025a-ac24-40ec-9f8f-2b8980b82c2e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:57.041145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9025a-ac24-40ec-9f8f-2b8980b82c2e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:57.041359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9025a-ac24-40ec-9f8f-2b8980b82c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:57.155328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-47f9025a-ac24-40ec-9f8f-2b8980b82c2e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:15:57.156490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-47f9025a-ac24-40ec-9f8f-2b8980b82c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:57.264402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 663/1313] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:15:57.299448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:15:57.301637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:57.407082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7c94-9b37-4d7b-af6f-a0bb52e2164f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:15:57.483526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:15:57.484072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:15:57.484355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:15:57.484647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:15:57.486381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:15:57.598474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:15:57.599948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fc731-241c-4dc6-862b-248a5b713732 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:15:57.618595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 651/1314] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:00.387699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf346d4-cead-473a-8b2c-9af5437211af None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:00.388177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf346d4-cead-473a-8b2c-9af5437211af None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:00.388270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf346d4-cead-473a-8b2c-9af5437211af None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:00.389652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 664/1315] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:00.394847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94d28-348c-4834-a687-16f70d5780e2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:00.395283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94d28-348c-4834-a687-16f70d5780e2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:00.395401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94d28-348c-4834-a687-16f70d5780e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:00.460733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d8d94d28-348c-4834-a687-16f70d5780e2 None None] MFA Rules not processed for user `686a67a5c5504371ad3aa3729db69baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:00.461916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d8d94d28-348c-4834-a687-16f70d5780e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:00.557472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 652/1316] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:00.611815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:00.612031 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:00.612308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:00.613708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 665/1317] 10.222.0.21 () {54 vars in 964 bytes} [Tue May 3 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:00.619505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea9f6d-db83-4f27-891b-a650a840b63d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:00.619788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea9f6d-db83-4f27-891b-a650a840b63d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:00.620059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea9f6d-db83-4f27-891b-a650a840b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:00.691277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5dea9f6d-db83-4f27-891b-a650a840b63d None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:00.692697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5dea9f6d-db83-4f27-891b-a650a840b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:00.764198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 653/1318] 10.222.0.21 () {58 vars in 1061 bytes} [Tue May 3 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:00.773833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:00.775350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:00.875089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45414-a6f1-43d6-bd7c-f2164466ff06 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:00.946573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:00.947207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:00.947487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:00.947757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:00.949400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:01.053751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:01.055187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524948-90cd-475f-881f-e541f66a521e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:01.072985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 666/1319] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:04.507919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:04.508497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:04.508497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:04.509880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 654/1320] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:04.515154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1850-73c4-40bd-bd8d-5237ba9d8773 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:04.515565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1850-73c4-40bd-bd8d-5237ba9d8773 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:04.515708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1850-73c4-40bd-bd8d-5237ba9d8773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:04.578634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b96f1850-73c4-40bd-bd8d-5237ba9d8773 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:04.579831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b96f1850-73c4-40bd-bd8d-5237ba9d8773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:04.671231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 667/1321] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:04.709715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:04.711203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:04.810049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b232-56b4-4d81-aa91-12097fae0dd3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:04.878027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:04.878673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:04.878950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:04.879223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:04.880848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:04.982958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:04.984305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fa820-7761-46f9-bf9f-d1d623deaf63 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:05.001864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 655/1322] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:08.197685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:08.198252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:08.198252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:08.199600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 668/1323] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:08.204853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c536ed-59b7-431a-9298-4078dee959eb None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:08.205236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c536ed-59b7-431a-9298-4078dee959eb None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:08.205415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c536ed-59b7-431a-9298-4078dee959eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:08.266672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-29c536ed-59b7-431a-9298-4078dee959eb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:08.267850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-29c536ed-59b7-431a-9298-4078dee959eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:08.359170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 656/1324] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:08.395336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:08.396885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:08.497174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd125-0733-4d67-a50b-00731d580d6c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:08.567086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:08.567725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:08.568000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:08.568265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:08.569917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:08.674552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:08.676834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bcba2-73d9-4657-a13c-baa464fc4ee1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:08.694392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 669/1325] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:11.033817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:11.034441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:11.034441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:11.035760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 657/1326] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:11.040953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0004-8608-4085-a943-93d6461fed90 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:11.041363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0004-8608-4085-a943-93d6461fed90 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:11.041504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0004-8608-4085-a943-93d6461fed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:11.104746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9acc0004-8608-4085-a943-93d6461fed90 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:11.106048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9acc0004-8608-4085-a943-93d6461fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:11.200424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 670/1327] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:11.235800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:11.237865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:11.343892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecf754-9d7e-4729-ad21-9d4efd4f835a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:11.418498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:11.419185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:11.419458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:11.419725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:11.421346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:11.524277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:11.525728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c08a82-447d-4621-9b5e-8e18cfdb7e37 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:11.543823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 658/1328] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:13.864312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:13.864897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:13.864897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:13.866741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 671/1329] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:13.872328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6052-39ee-4fb8-9dc7-081573921e13 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:13.873298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6052-39ee-4fb8-9dc7-081573921e13 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:13.873576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6052-39ee-4fb8-9dc7-081573921e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:13.936209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0bbd6052-39ee-4fb8-9dc7-081573921e13 None None] MFA Rules not processed for user `686a67a5c5504371ad3aa3729db69baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:13.937399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0bbd6052-39ee-4fb8-9dc7-081573921e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:14.029482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 659/1330] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:14.067453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:14.068968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:14.166768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e49a1-c898-4331-9b42-d46da0a03dcd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:14.236492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:14.237667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:14.237943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:14.238211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:14.239877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:14.344813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:14.346272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f991e-3be9-4009-a3b0-3cc9b9760b70 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:14.364344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 672/1331] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:17.106562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:17.107044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:17.107141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:17.108674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 660/1332] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:17.114240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd5-11c0-4035-bf43-c196da65231a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:17.114680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd5-11c0-4035-bf43-c196da65231a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:17.114784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd5-11c0-4035-bf43-c196da65231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:17.178133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c10cafd5-11c0-4035-bf43-c196da65231a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:17.179325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c10cafd5-11c0-4035-bf43-c196da65231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:17.270665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 673/1333] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:16:17.306416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:17.307942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:17.417975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ade4-c269-42ba-a1ab-c99177300bb2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:17.491366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:17.492028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:17.492305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:17.492605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:17.494244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:17.602922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:17.604277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1675c-b7a6-4cde-ada6-7d112fddbab9 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:17.621846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 661/1334] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:19.934814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:19.935350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:19.935350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:19.936764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 674/1335] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:19.941897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831559-6bf3-45d1-98ed-c747d8963ca6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:19.942357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831559-6bf3-45d1-98ed-c747d8963ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:19.942468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831559-6bf3-45d1-98ed-c747d8963ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:20.003745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-84831559-6bf3-45d1-98ed-c747d8963ca6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:20.004897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-84831559-6bf3-45d1-98ed-c747d8963ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:20.098247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 662/1336] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:20.137563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:20.139064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:20.237853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a75f3b-11a4-4c7b-82fb-bf187d038407 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:20.306617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:20.307193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:20.307471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:20.307741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:20.309366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:20.412829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:20.414256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e53c8-bbd9-477a-9c67-0e488a42355a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:20.431519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 675/1337] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:23.348697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:23.349132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:23.349237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:23.350620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 663/1338] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:23.356075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427277c-b817-4c25-99da-8e9a8b53da27 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:23.356510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427277c-b817-4c25-99da-8e9a8b53da27 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:23.356658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427277c-b817-4c25-99da-8e9a8b53da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:23.418448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0427277c-b817-4c25-99da-8e9a8b53da27 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:23.419625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0427277c-b817-4c25-99da-8e9a8b53da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:23.512663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 676/1339] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:23.547786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:23.549961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:23.649561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fec34-fcd2-47dc-a876-331c43b266ae None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:23.722946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:23.723584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:23.723857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:23.724125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:23.726158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:23.832918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:23.834431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acf2a8-819a-45a7-91d2-795be8d83759 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:23.851297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 664/1340] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:28.398450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:28.399006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:28.399006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:28.400413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 677/1341] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:28.405659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f95cf-7715-4df5-9567-bee376272f21 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:28.406198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f95cf-7715-4df5-9567-bee376272f21 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:28.406198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f95cf-7715-4df5-9567-bee376272f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:28.450985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0b8f95cf-7715-4df5-9567-bee376272f21 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:28.452191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0b8f95cf-7715-4df5-9567-bee376272f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:28.527853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 665/1342] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:28.566731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:28.568885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:28.643801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c24d4f-5c04-4261-91d6-565153d3e829 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:28.647293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:28.647924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:28.648208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:28.648510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:28.657458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:28.659500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8827-e68a-458e-b63b-8a1bbfb7901d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:28.669123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 678/1343] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:31.816146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:31.816688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:31.816824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:31.818136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 666/1344] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:31.823468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a3e6-4229-4baa-801d-78d2201ee75e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:31.823886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a3e6-4229-4baa-801d-78d2201ee75e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:31.824136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a3e6-4229-4baa-801d-78d2201ee75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:31.851157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a9a1a3e6-4229-4baa-801d-78d2201ee75e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:31.852481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a9a1a3e6-4229-4baa-801d-78d2201ee75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:31.869195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 679/1345] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:31.906242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:31.907987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:31.920675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446da8-62f9-46b0-8042-366d9f9dbecc None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:31.924094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:31.924762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:31.925042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:31.925583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:31.934482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:31.935904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c68f5-11a1-4536-9530-f2389947ef8f service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:31.945643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 667/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:36.590107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473c07-c1a0-44c6-b6e8-4648b0498a00 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:36.590631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473c07-c1a0-44c6-b6e8-4648b0498a00 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:36.590631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473c07-c1a0-44c6-b6e8-4648b0498a00 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:36.592002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 680/1347] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:16:36.597320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7cea-c878-47d5-aefe-48974923c7e6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:36.597715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7cea-c878-47d5-aefe-48974923c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:36.597833 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7cea-c878-47d5-aefe-48974923c7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:36.615694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d20e7cea-c878-47d5-aefe-48974923c7e6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:36.616890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d20e7cea-c878-47d5-aefe-48974923c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:36.624563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 668/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:36.662480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473c07-c1a0-44c6-b6e8-4648b0498a00 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:36.672847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473c07-c1a0-44c6-b6e8-4648b0498a00 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:36.677118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:36.677749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:36.678029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:36.678300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:36.687168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:36.688608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f3f2-5e1c-4f98-ad70-1912ee777a2d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:36.698745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 681/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:42.004789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768683-f865-4fcd-b377-a18e8881efd8 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:42.005718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768683-f865-4fcd-b377-a18e8881efd8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:42.006215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768683-f865-4fcd-b377-a18e8881efd8 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:42.008079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 669/1350] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:42.013250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82315d-a039-4603-adf4-8bfa0e69c544 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:42.013678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82315d-a039-4603-adf4-8bfa0e69c544 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:42.013791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82315d-a039-4603-adf4-8bfa0e69c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:42.083999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cd82315d-a039-4603-adf4-8bfa0e69c544 None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:42.085452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cd82315d-a039-4603-adf4-8bfa0e69c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:42.166998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 682/1351] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:46.425265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db60c6-cd82-4a0e-a39d-a70604964192 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:46.426283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db60c6-cd82-4a0e-a39d-a70604964192 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:46.426661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db60c6-cd82-4a0e-a39d-a70604964192 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:46.428636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 670/1352] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:46.434640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a3c-a36c-4f2b-9c45-03dc04faa9b8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:46.435220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a3c-a36c-4f2b-9c45-03dc04faa9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:46.435220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b90a3c-a36c-4f2b-9c45-03dc04faa9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:46.453971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b7b90a3c-a36c-4f2b-9c45-03dc04faa9b8 None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:46.455733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7b90a3c-a36c-4f2b-9c45-03dc04faa9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:46.464482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 683/1353] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:16:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:47.843066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9652-2c39-49d1-b42b-7ab754caf1e7 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:47.843624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9652-2c39-49d1-b42b-7ab754caf1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:47.843624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9652-2c39-49d1-b42b-7ab754caf1e7 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:47.845535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 671/1354] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:47.850550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d975d0-c025-479d-a90c-7fc42bf7d3ed None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:47.850968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d975d0-c025-479d-a90c-7fc42bf7d3ed None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:47.851221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d975d0-c025-479d-a90c-7fc42bf7d3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:47.868772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-84d975d0-c025-479d-a90c-7fc42bf7d3ed None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:47.870113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-84d975d0-c025-479d-a90c-7fc42bf7d3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:47.878674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 684/1355] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:16:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:51.804210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400722-765d-401b-9bf4-3e7990f2894a None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:51.804772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400722-765d-401b-9bf4-3e7990f2894a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:51.805008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400722-765d-401b-9bf4-3e7990f2894a None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:51.806614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 672/1356] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:51.811426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80648-9aba-4d4a-b8bf-b34f18c967ee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:51.811839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80648-9aba-4d4a-b8bf-b34f18c967ee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:51.811974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80648-9aba-4d4a-b8bf-b34f18c967ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:51.830131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-11a80648-9aba-4d4a-b8bf-b34f18c967ee None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:51.831493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-11a80648-9aba-4d4a-b8bf-b34f18c967ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:51.839368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 685/1357] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:51.886475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4747bc-7153-4681-8ca5-c4198df2daa6 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:51.886878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4747bc-7153-4681-8ca5-c4198df2daa6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:51.887259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4747bc-7153-4681-8ca5-c4198df2daa6 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:51.888977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 673/1358] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:51.894124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8f9a-ccf1-4a19-a554-ce9ae1304b57 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:51.894528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8f9a-ccf1-4a19-a554-ce9ae1304b57 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:51.894932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8f9a-ccf1-4a19-a554-ce9ae1304b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:51.943095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-62ad8f9a-ccf1-4a19-a554-ce9ae1304b57 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:51.944268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62ad8f9a-ccf1-4a19-a554-ce9ae1304b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:52.024716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 686/1359] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:52.033523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4747bc-7153-4681-8ca5-c4198df2daa6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:52.048755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4747bc-7153-4681-8ca5-c4198df2daa6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:52.054929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:52.055755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:52.056182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:52.056628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:52.065500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:52.067242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bfb50-1472-409c-9ee4-31595d5daf84 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:52.092569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 674/1360] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:54.543868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062e-5eaa-4740-a36e-3fbee9868890 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:54.544639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062e-5eaa-4740-a36e-3fbee9868890 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:54.544639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062e-5eaa-4740-a36e-3fbee9868890 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:54.545774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 687/1361] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:54.551193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc23811-4936-40d4-8d97-60f35b187715 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:54.551624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc23811-4936-40d4-8d97-60f35b187715 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:54.551743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc23811-4936-40d4-8d97-60f35b187715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:54.569351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8dc23811-4936-40d4-8d97-60f35b187715 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:54.570653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8dc23811-4936-40d4-8d97-60f35b187715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:54.580309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 675/1362] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:54.624738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac062e-5eaa-4740-a36e-3fbee9868890 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:54.638850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac062e-5eaa-4740-a36e-3fbee9868890 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:54.644674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:54.645291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:54.645568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:54.645839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:54.653725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:54.655299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0687-3318-4bfc-bbf9-7294f3b7b5ff service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:54.665131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 688/1363] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:57.321431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba384b-70e8-4ad2-a311-604195384437 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:57.321967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba384b-70e8-4ad2-a311-604195384437 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:57.321967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba384b-70e8-4ad2-a311-604195384437 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:57.323357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 676/1364] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:57.328777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24bc1-62bf-4640-88ec-65a2c579b111 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:57.329734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24bc1-62bf-4640-88ec-65a2c579b111 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:57.329865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24bc1-62bf-4640-88ec-65a2c579b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:57.348159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-90f24bc1-62bf-4640-88ec-65a2c579b111 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:57.349386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-90f24bc1-62bf-4640-88ec-65a2c579b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:57.357197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 689/1365] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:57.403545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfec7-8ad3-4244-a7ee-7a7341edf12e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:57.403834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfec7-8ad3-4244-a7ee-7a7341edf12e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:57.404115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfec7-8ad3-4244-a7ee-7a7341edf12e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:57.405513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 677/1366] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:57.410751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645a26-982f-49a0-922d-2eaaa7dd454a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:57.411036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645a26-982f-49a0-922d-2eaaa7dd454a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:57.411333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24645a26-982f-49a0-922d-2eaaa7dd454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:57.429667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-24645a26-982f-49a0-922d-2eaaa7dd454a None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:57.430955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-24645a26-982f-49a0-922d-2eaaa7dd454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:16:57.440802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 690/1367] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:16:57.448654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfec7-8ad3-4244-a7ee-7a7341edf12e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:16:57.463273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfec7-8ad3-4244-a7ee-7a7341edf12e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:16:57.468758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:16:57.469464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:57.469756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:57.470032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:57.477891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:16:57.479455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c8dcc-9545-4c5d-a8b9-a3b098f04d1d service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:16:57.488854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 678/1368] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:16:59.967430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcdc37-fdce-4517-bc64-2eab645fc602 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:59.967986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcdc37-fdce-4517-bc64-2eab645fc602 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:59.967986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcdc37-fdce-4517-bc64-2eab645fc602 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:59.970087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 691/1369] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:16:59.975073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56b56-9c12-4cd5-9eb2-d74da8746161 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:16:59.975846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56b56-9c12-4cd5-9eb2-d74da8746161 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:16:59.976281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56b56-9c12-4cd5-9eb2-d74da8746161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:16:59.995056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b8d56b56-9c12-4cd5-9eb2-d74da8746161 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:16:59.996527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b8d56b56-9c12-4cd5-9eb2-d74da8746161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:00.004672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 679/1370] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:00.019186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b226-c589-4fab-bdd3-e0cf417feaab None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.019731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b226-c589-4fab-bdd3-e0cf417feaab None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.020012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b226-c589-4fab-bdd3-e0cf417feaab None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.021454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 692/1371] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:00.027566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa435-940b-487c-bdd1-cb669fd1861e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.027918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa435-940b-487c-bdd1-cb669fd1861e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.028129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa435-940b-487c-bdd1-cb669fd1861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.048051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2a5fa435-940b-487c-bdd1-cb669fd1861e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:00.049293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2a5fa435-940b-487c-bdd1-cb669fd1861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:00.051079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b226-c589-4fab-bdd3-e0cf417feaab None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:00.058645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 680/1372] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:00.066770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b226-c589-4fab-bdd3-e0cf417feaab None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:00.072813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:00.073457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.073738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.074011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.083203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:00.084827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760d1c-217a-4f06-bb15-79caa6096d97 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:00.096831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 693/1373] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:17:00.386344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff94e-1ec3-47e7-9324-51110bfb2f3c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.386632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff94e-1ec3-47e7-9324-51110bfb2f3c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.387156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff94e-1ec3-47e7-9324-51110bfb2f3c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.388938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 681/1374] 10.222.0.21 () {54 vars in 963 bytes} [Tue May 3 12:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:00.395348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391128b-eb0b-4e90-93c4-b505a9ae59e6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.395649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391128b-eb0b-4e90-93c4-b505a9ae59e6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.397510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391128b-eb0b-4e90-93c4-b505a9ae59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.452203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a391128b-eb0b-4e90-93c4-b505a9ae59e6 None None] MFA Rules not processed for user `f8055b211f0f48ee89f209dacd33837c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:00.453479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a391128b-eb0b-4e90-93c4-b505a9ae59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:00.527300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 694/1375] 10.222.0.21 () {58 vars in 1060 bytes} [Tue May 3 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:00.528569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff94e-1ec3-47e7-9324-51110bfb2f3c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:00.539165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff94e-1ec3-47e7-9324-51110bfb2f3c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:00.542649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:00.543530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:00.543984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:00.544485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:00.554514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:00.556064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba7e9-60e8-4d57-af4b-7918e01a8ec9 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:00.566566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 682/1376] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:02.603600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94090ee-8cd6-434b-b871-a930b5b2c9f6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:02.604107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94090ee-8cd6-434b-b871-a930b5b2c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:02.604107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94090ee-8cd6-434b-b871-a930b5b2c9f6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:02.605469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 695/1377] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:02.610781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82447-9b95-4146-81b1-03c35dc023eb None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:02.611213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82447-9b95-4146-81b1-03c35dc023eb None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:02.611360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82447-9b95-4146-81b1-03c35dc023eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:02.629461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9ba82447-9b95-4146-81b1-03c35dc023eb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:02.630777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9ba82447-9b95-4146-81b1-03c35dc023eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:02.638845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 683/1378] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:02.686288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94090ee-8cd6-434b-b871-a930b5b2c9f6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:02.701439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94090ee-8cd6-434b-b871-a930b5b2c9f6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:02.707735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:02.708555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:02.708846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:02.709272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:02.719293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:02.720976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec634e-50fb-4d0a-8775-768356c2bb3b service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:02.730754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 696/1379] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:05.142922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5290bf-53b5-4ee2-9022-5b64c0e21355 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:05.143487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5290bf-53b5-4ee2-9022-5b64c0e21355 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:05.143487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5290bf-53b5-4ee2-9022-5b64c0e21355 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:05.144872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 684/1380] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:05.149955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6750e-f3d9-4869-aad2-3a603f5bd8a6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:05.150342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6750e-f3d9-4869-aad2-3a603f5bd8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:05.150507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6750e-f3d9-4869-aad2-3a603f5bd8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:05.169197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c0f6750e-f3d9-4869-aad2-3a603f5bd8a6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:05.170494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c0f6750e-f3d9-4869-aad2-3a603f5bd8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:05.180408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 697/1381] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:05.223207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5290bf-53b5-4ee2-9022-5b64c0e21355 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:05.238977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5290bf-53b5-4ee2-9022-5b64c0e21355 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:05.244842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:05.245658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:05.246039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:05.247326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:05.258496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:05.261044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4daa3b-a004-4939-9183-9f0f640e2271 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:05.274480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 685/1382] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:07.710267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc65a-5ec6-4865-9a7a-136a5b6423ca None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:07.710828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc65a-5ec6-4865-9a7a-136a5b6423ca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:07.711099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc65a-5ec6-4865-9a7a-136a5b6423ca None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:07.712630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 698/1383] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:07.718066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565772f-64d2-4fdc-ad97-6e4862bf0f8d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:07.718508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565772f-64d2-4fdc-ad97-6e4862bf0f8d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:07.719340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565772f-64d2-4fdc-ad97-6e4862bf0f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:07.738754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e565772f-64d2-4fdc-ad97-6e4862bf0f8d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:07.740110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e565772f-64d2-4fdc-ad97-6e4862bf0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:07.751474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 686/1384] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:07.793176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcc65a-5ec6-4865-9a7a-136a5b6423ca None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:07.808766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcc65a-5ec6-4865-9a7a-136a5b6423ca None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:07.814324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:07.815024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:07.815446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:07.815721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:07.823992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:07.825821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861962f8-8150-4a07-83a0-4f577f88058f service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:07.835391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 699/1385] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:10.100903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982c58-d0c6-4335-a6ad-f2d53b0c507c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:10.101511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982c58-d0c6-4335-a6ad-f2d53b0c507c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:10.101511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c982c58-d0c6-4335-a6ad-f2d53b0c507c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:10.102838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 687/1386] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:10.108157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026e49-262e-49cc-948f-20b111d1a1e1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:10.108694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026e49-262e-49cc-948f-20b111d1a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:10.108790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026e49-262e-49cc-948f-20b111d1a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:10.126712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f8026e49-262e-49cc-948f-20b111d1a1e1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:10.127872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8026e49-262e-49cc-948f-20b111d1a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:10.135945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 700/1387] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:10.182047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c982c58-d0c6-4335-a6ad-f2d53b0c507c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:10.196988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c982c58-d0c6-4335-a6ad-f2d53b0c507c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:10.202497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:10.203710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:10.204009 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:10.204273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:10.212764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:10.214339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0ad7-0501-4eb5-b5b6-1632ce136459 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:10.223735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 688/1388] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:13.232928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbecb5-3987-4139-b69f-b16d34f6c38e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:13.233567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbecb5-3987-4139-b69f-b16d34f6c38e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:13.233567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbecb5-3987-4139-b69f-b16d34f6c38e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:13.235495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 701/1389] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:13.241033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae4a9-3f3b-4e05-a996-92b2c5418e16 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:13.241556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae4a9-3f3b-4e05-a996-92b2c5418e16 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:13.241715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae4a9-3f3b-4e05-a996-92b2c5418e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:13.259943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ac8ae4a9-3f3b-4e05-a996-92b2c5418e16 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:13.261243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ac8ae4a9-3f3b-4e05-a996-92b2c5418e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:13.271304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 689/1390] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:13.319133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbecb5-3987-4139-b69f-b16d34f6c38e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:13.334198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbecb5-3987-4139-b69f-b16d34f6c38e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:13.341070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:13.342125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:13.342478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:13.342823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:13.354376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:13.355960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8915767-8bad-40e5-863d-cbea3ace12ec service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:13.365604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 702/1391] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:15.850504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ef5b-1c01-46fb-a9c9-ebbec2ce892f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:15.851098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ef5b-1c01-46fb-a9c9-ebbec2ce892f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:15.851098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ef5b-1c01-46fb-a9c9-ebbec2ce892f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:15.852516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 690/1392] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:15.857678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca5e6f-fc04-46ad-90b4-b07a2724abb4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:15.858120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca5e6f-fc04-46ad-90b4-b07a2724abb4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:15.858229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca5e6f-fc04-46ad-90b4-b07a2724abb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:15.876751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f7ca5e6f-fc04-46ad-90b4-b07a2724abb4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:15.877944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f7ca5e6f-fc04-46ad-90b4-b07a2724abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:15.885786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 703/1393] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:15.930086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ef5b-1c01-46fb-a9c9-ebbec2ce892f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:15.944210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ef5b-1c01-46fb-a9c9-ebbec2ce892f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:15.949557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:15.950187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:15.950469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:15.950741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:15.958722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:15.960303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343018e3-8e5d-4b8a-8577-37e2c8688ef4 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:15.970071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 691/1394] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:16.514022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f255d-d14a-4e0c-bbcc-66a160ffef32 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:16.514306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f255d-d14a-4e0c-bbcc-66a160ffef32 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:16.514577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f255d-d14a-4e0c-bbcc-66a160ffef32 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:16.516495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 704/1395] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:16.521696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef990-561e-4bd9-bf5a-893d5e82b90b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:16.522013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef990-561e-4bd9-bf5a-893d5e82b90b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:16.522292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef990-561e-4bd9-bf5a-893d5e82b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:16.539955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2fcef990-561e-4bd9-bf5a-893d5e82b90b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:16.541172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2fcef990-561e-4bd9-bf5a-893d5e82b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:16.548927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 692/1396] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:16.605076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa65-d310-449d-932c-0d918d27777b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:16.605378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa65-d310-449d-932c-0d918d27777b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:16.605663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9fa65-d310-449d-932c-0d918d27777b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:16.607004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 705/1397] 10.222.0.21 () {54 vars in 962 bytes} [Tue May 3 12:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:16.611936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710280-2501-47d8-9da1-0f2534200a71 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:16.612229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710280-2501-47d8-9da1-0f2534200a71 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:16.612648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710280-2501-47d8-9da1-0f2534200a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:16.658217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e8710280-2501-47d8-9da1-0f2534200a71 None None] MFA Rules not processed for user `e0e3a64bbcfa4449b4aba61a201c1c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:16.659373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e8710280-2501-47d8-9da1-0f2534200a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:16.715989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 693/1398] 10.222.0.21 () {58 vars in 1059 bytes} [Tue May 3 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:16.723508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fa65-d310-449d-932c-0d918d27777b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:16.733833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9fa65-d310-449d-932c-0d918d27777b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:16.737514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:16.738228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:16.738606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:16.738939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:16.747658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:16.749169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959a52-8f9c-4133-a18f-b652ef49128b service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:16.758891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 706/1399] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:17.333758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22b47-1ef2-447c-b469-96bec1f5088a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:17.334617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22b47-1ef2-447c-b469-96bec1f5088a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:17.334953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22b47-1ef2-447c-b469-96bec1f5088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:17.381839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-53e22b47-1ef2-447c-b469-96bec1f5088a None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:17.383012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-53e22b47-1ef2-447c-b469-96bec1f5088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:17.443208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 694/1400] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:17.483822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f36acd-9091-4d76-940d-d8f366bb61f7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:17.484942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f36acd-9091-4d76-940d-d8f366bb61f7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:17.485066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f36acd-9091-4d76-940d-d8f366bb61f7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:17.486368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 707/1401] 10.222.0.21 () {54 vars in 942 bytes} [Tue May 3 12:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:17.492726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa1c7-71d8-4af6-aeae-6001705c9a4b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:17.493020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa1c7-71d8-4af6-aeae-6001705c9a4b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:17.493300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa1c7-71d8-4af6-aeae-6001705c9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:17.540949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-016fa1c7-71d8-4af6-aeae-6001705c9a4b None None] MFA Rules not processed for user `cb8f96204ad44d3888970d5335afad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:17.542133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-016fa1c7-71d8-4af6-aeae-6001705c9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:17.610779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 695/1402] 10.222.0.21 () {58 vars in 1039 bytes} [Tue May 3 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:17.620096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f36acd-9091-4d76-940d-d8f366bb61f7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:17.633447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f36acd-9091-4d76-940d-d8f366bb61f7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:17.638354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:17.638989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:17.639274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:17.639549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:17.647493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:17.649106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d245c-3d2b-4182-931c-e890c2563170 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:17.657585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 708/1403] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:17:18.405260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878da4d-a893-4c73-9278-4d7b123ab768 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:18.405814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878da4d-a893-4c73-9278-4d7b123ab768 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:18.405956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878da4d-a893-4c73-9278-4d7b123ab768 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:18.409079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 696/1404] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:18.413756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763b42-d5e9-4634-8e75-af74390c2b5b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:18.418298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763b42-d5e9-4634-8e75-af74390c2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:18.418298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763b42-d5e9-4634-8e75-af74390c2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:18.432511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0763b42-d5e9-4634-8e75-af74390c2b5b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:18.433738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0763b42-d5e9-4634-8e75-af74390c2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:18.443159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 709/1405] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:18.487442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878da4d-a893-4c73-9278-4d7b123ab768 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:18.503730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878da4d-a893-4c73-9278-4d7b123ab768 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:18.509538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:18.510239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:18.510541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:18.510809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:18.519941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:18.521650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c572394-5f71-49dd-b1d8-76da53ff80ad service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:18.531306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 697/1406] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:20.992720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b1e4-49ca-46d1-9d18-eddceb92b154 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:20.993237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b1e4-49ca-46d1-9d18-eddceb92b154 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:20.993237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b1e4-49ca-46d1-9d18-eddceb92b154 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:20.994561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 710/1407] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:20.999785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06280367-3504-4161-bb99-2e02f663ffbd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:21.000214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06280367-3504-4161-bb99-2e02f663ffbd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:21.000410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06280367-3504-4161-bb99-2e02f663ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:21.026928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-06280367-3504-4161-bb99-2e02f663ffbd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:21.028108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-06280367-3504-4161-bb99-2e02f663ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:21.038859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 698/1408] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:21.082784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b1e4-49ca-46d1-9d18-eddceb92b154 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:21.097861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b1e4-49ca-46d1-9d18-eddceb92b154 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:21.103325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:21.104000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:21.104285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:21.104588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:21.113591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:21.115210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453194be-142a-446e-bda2-335dd27cc809 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:21.125640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 711/1409] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:42.209790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e4ae-ff25-4e9a-928f-1334a4e6257d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:42.210447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e4ae-ff25-4e9a-928f-1334a4e6257d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:42.210447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1e4ae-ff25-4e9a-928f-1334a4e6257d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:42.211797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 699/1410] 10.222.0.21 () {54 vars in 918 bytes} [Tue May 3 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:42.216940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094b3d-ac2f-499f-bfae-c540543d2e4a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:42.217442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094b3d-ac2f-499f-bfae-c540543d2e4a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:42.217547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094b3d-ac2f-499f-bfae-c540543d2e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:42.234598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-21094b3d-ac2f-499f-bfae-c540543d2e4a None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:42.237172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-21094b3d-ac2f-499f-bfae-c540543d2e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:42.244003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 712/1411] 10.222.0.21 () {58 vars in 1015 bytes} [Tue May 3 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:42.258367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fb1e-9280-4200-bb75-333e6ff2ce39 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:42.258676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fb1e-9280-4200-bb75-333e6ff2ce39 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:42.258948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fb1e-9280-4200-bb75-333e6ff2ce39 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:42.260265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 700/1412] 10.222.0.21 () {54 vars in 918 bytes} [Tue May 3 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:42.265320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7b62-4f61-492f-a822-21b9e627f7c2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:42.265608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7b62-4f61-492f-a822-21b9e627f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:42.265913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7b62-4f61-492f-a822-21b9e627f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:42.282909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-01cf7b62-4f61-492f-a822-21b9e627f7c2 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:42.284076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-01cf7b62-4f61-492f-a822-21b9e627f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:42.293506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 713/1413] 10.222.0.21 () {58 vars in 1015 bytes} [Tue May 3 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:44.970100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab92a-c78b-4fd2-b595-42a0883f22a6 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:44.970694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab92a-c78b-4fd2-b595-42a0883f22a6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:44.970694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab92a-c78b-4fd2-b595-42a0883f22a6 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:44.971987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:44.977185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8818b-e663-49a7-bfac-a5ecbfb96ee6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:44.977565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8818b-e663-49a7-bfac-a5ecbfb96ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:44.977733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8818b-e663-49a7-bfac-a5ecbfb96ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:44.995984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6bc8818b-e663-49a7-bfac-a5ecbfb96ee6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:44.997179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6bc8818b-e663-49a7-bfac-a5ecbfb96ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:45.005393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:45.045970 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab92a-c78b-4fd2-b595-42a0883f22a6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:45.059729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab92a-c78b-4fd2-b595-42a0883f22a6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:45.065582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:45.066206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:45.066482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:45.066750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:45.075049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:45.076661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a955-1612-4ec7-839f-c58b1d649926 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:45.086092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 702/1416] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:17:46.396498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0291a7-32d4-45a9-90c1-421ac5be032c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:46.397035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0291a7-32d4-45a9-90c1-421ac5be032c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:46.397035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0291a7-32d4-45a9-90c1-421ac5be032c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:46.398317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:46.403231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2eb4-bafe-46f8-84d9-27132c0aab23 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:46.403668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2eb4-bafe-46f8-84d9-27132c0aab23 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:46.403778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2eb4-bafe-46f8-84d9-27132c0aab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:46.421813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7f3f2eb4-bafe-46f8-84d9-27132c0aab23 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:46.422972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7f3f2eb4-bafe-46f8-84d9-27132c0aab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:46.430874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:46.591424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0291a7-32d4-45a9-90c1-421ac5be032c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:46.605814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0291a7-32d4-45a9-90c1-421ac5be032c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:46.610996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:46.611614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:46.611887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:46.612151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:46.619781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:46.621371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e7c6-08d5-4b33-8317-72f96773a051 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:46.630319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 716/1419] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:47.915601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161161a4-12c3-4005-b222-fe6ea7c8cc06 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:47.916168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161161a4-12c3-4005-b222-fe6ea7c8cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:47.916168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161161a4-12c3-4005-b222-fe6ea7c8cc06 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:47.917551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:47.922503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec49f2-0021-4e73-af48-10861544ee1c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:47.922952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec49f2-0021-4e73-af48-10861544ee1c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:47.923084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec49f2-0021-4e73-af48-10861544ee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:47.940773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7dec49f2-0021-4e73-af48-10861544ee1c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:47.941948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7dec49f2-0021-4e73-af48-10861544ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:47.949610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:48.098860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161161a4-12c3-4005-b222-fe6ea7c8cc06 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:48.114695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161161a4-12c3-4005-b222-fe6ea7c8cc06 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:48.120636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:48.121263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:48.121539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:48.121808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:48.129633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:48.131187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137f8ce-ec7b-405b-8c13-be1d0191a70f service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:48.140731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 705/1422] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:49.364127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334418fc-cf45-46e2-bb41-9c3cb8d3773f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:49.364607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334418fc-cf45-46e2-bb41-9c3cb8d3773f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:49.364712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334418fc-cf45-46e2-bb41-9c3cb8d3773f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:49.366047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:49.371141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213c96-2786-41bd-906f-d22c65101bb0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:49.371556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213c96-2786-41bd-906f-d22c65101bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:49.371688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213c96-2786-41bd-906f-d22c65101bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:49.389465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-82213c96-2786-41bd-906f-d22c65101bb0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:49.390630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-82213c96-2786-41bd-906f-d22c65101bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:49.398483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:49.544540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334418fc-cf45-46e2-bb41-9c3cb8d3773f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:49.558515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334418fc-cf45-46e2-bb41-9c3cb8d3773f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:49.563747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:49.564389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:49.564670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:49.564937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:49.572707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:49.574254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e75b3-f2db-4b8f-821e-f00e7cc89c99 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:49.583722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 719/1425] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:50.828841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153711-ae15-405b-ba12-56b4f260aea0 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:50.829434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153711-ae15-405b-ba12-56b4f260aea0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:50.829434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153711-ae15-405b-ba12-56b4f260aea0 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:50.830771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:50.835916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9dd-bc19-4abe-9412-1ff190251500 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:50.836334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9dd-bc19-4abe-9412-1ff190251500 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:50.836568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9dd-bc19-4abe-9412-1ff190251500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:50.854643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4585d9dd-bc19-4abe-9412-1ff190251500 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:50.855831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4585d9dd-bc19-4abe-9412-1ff190251500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:50.863831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:51.010482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153711-ae15-405b-ba12-56b4f260aea0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:51.025856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153711-ae15-405b-ba12-56b4f260aea0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:51.033025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:51.033677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:51.033977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:51.034246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:51.042724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:51.044289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cdcf-2259-49de-8083-d84c2f7025cb service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:51.054132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 708/1428] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:52.298802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd8a5-884b-41fc-b1ab-943a46aed44e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:52.299365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd8a5-884b-41fc-b1ab-943a46aed44e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:52.299365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd8a5-884b-41fc-b1ab-943a46aed44e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:52.301038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:52.305923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da97f-9d9f-4006-8b48-6420340a6759 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:52.306348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da97f-9d9f-4006-8b48-6420340a6759 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:52.306482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da97f-9d9f-4006-8b48-6420340a6759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:52.324490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-223da97f-9d9f-4006-8b48-6420340a6759 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:52.325674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-223da97f-9d9f-4006-8b48-6420340a6759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:52.333559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:52.481304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd8a5-884b-41fc-b1ab-943a46aed44e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:52.495667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd8a5-884b-41fc-b1ab-943a46aed44e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:52.501667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:52.502288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:52.502568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:52.502840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:52.510642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:52.512200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51217890-e8c5-4267-a172-1b23c9946fec service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:52.521310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 722/1431] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:53.768974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32f11-b2fd-46ac-a217-a4ad44b29167 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:53.769400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32f11-b2fd-46ac-a217-a4ad44b29167 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:53.769533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32f11-b2fd-46ac-a217-a4ad44b29167 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:53.770914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:53.775840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b636-43fb-4ef5-9c41-fe88fbf2bd82 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:53.776252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b636-43fb-4ef5-9c41-fe88fbf2bd82 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:53.776415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b636-43fb-4ef5-9c41-fe88fbf2bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:53.793766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe36b636-43fb-4ef5-9c41-fe88fbf2bd82 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:53.795460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe36b636-43fb-4ef5-9c41-fe88fbf2bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:53.803422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:53.950006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32f11-b2fd-46ac-a217-a4ad44b29167 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:53.963696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32f11-b2fd-46ac-a217-a4ad44b29167 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:53.968952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:53.969600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:53.969877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:53.970147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:53.977888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:53.979447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce98e8-1632-42b5-8f81-451888ac43cf service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:53.989352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 711/1434] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:55.226390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5596f3-bc53-4700-a8dd-84ab7cfe49db None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:55.226976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5596f3-bc53-4700-a8dd-84ab7cfe49db None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:55.226976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5596f3-bc53-4700-a8dd-84ab7cfe49db None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:55.228282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:55.233273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a570-8040-4602-8c3c-e11633c37046 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:55.233730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a570-8040-4602-8c3c-e11633c37046 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:55.233826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a570-8040-4602-8c3c-e11633c37046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:55.251861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9109a570-8040-4602-8c3c-e11633c37046 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:55.253066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9109a570-8040-4602-8c3c-e11633c37046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:55.260844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:55.411830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5596f3-bc53-4700-a8dd-84ab7cfe49db None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:55.426726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5596f3-bc53-4700-a8dd-84ab7cfe49db None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:55.432021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:55.432677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:55.432951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:55.433217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:55.441685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:55.443235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53d55b-0307-4e32-8fba-58612b3e8b1a service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:55.452306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 725/1437] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:56.672919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2220577-c2b3-4cca-ae8c-93181eb469b0 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:56.673506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2220577-c2b3-4cca-ae8c-93181eb469b0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:56.673506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2220577-c2b3-4cca-ae8c-93181eb469b0 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:56.675029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:56.679830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd523f9-e27c-47a3-acfa-fcef7fc2ed46 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:56.680215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd523f9-e27c-47a3-acfa-fcef7fc2ed46 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:56.680385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd523f9-e27c-47a3-acfa-fcef7fc2ed46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:56.698040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7fd523f9-e27c-47a3-acfa-fcef7fc2ed46 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:56.699206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7fd523f9-e27c-47a3-acfa-fcef7fc2ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:56.707261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:17:56.853315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2220577-c2b3-4cca-ae8c-93181eb469b0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:56.867572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2220577-c2b3-4cca-ae8c-93181eb469b0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:56.873455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:56.874115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:56.874394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:56.874667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:56.882375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:56.883937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683f9e-aac5-4fa1-b0cc-33e3a2caeef1 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:56.893005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 714/1440] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:17:59.003279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd33c5-489c-409f-918b-c132de8b3022 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:59.003865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd33c5-489c-409f-918b-c132de8b3022 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:59.003865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd33c5-489c-409f-918b-c132de8b3022 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:59.005229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:17:59.010491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011f12-5a70-493c-b669-48d44b313d58 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:59.010922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011f12-5a70-493c-b669-48d44b313d58 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:59.011053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011f12-5a70-493c-b669-48d44b313d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:59.028840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5f011f12-5a70-493c-b669-48d44b313d58 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:17:59.030639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5f011f12-5a70-493c-b669-48d44b313d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:17:59.038355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:17:59.076497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd33c5-489c-409f-918b-c132de8b3022 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:17:59.087083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd33c5-489c-409f-918b-c132de8b3022 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:17:59.090490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:17:59.091105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:17:59.091380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:17:59.092194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:17:59.100782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:17:59.102178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046d363-853f-412e-a9f1-c66cbe3888d2 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:17:59.111123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 728/1443] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:01.529377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670ca-0896-4455-8040-55ff45ebcd2d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:01.530053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670ca-0896-4455-8040-55ff45ebcd2d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:01.530053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670ca-0896-4455-8040-55ff45ebcd2d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:01.531557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:01.537104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a97e2-40a0-4a41-a6de-a09552d5b6cf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:01.537557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a97e2-40a0-4a41-a6de-a09552d5b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:01.537666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a97e2-40a0-4a41-a6de-a09552d5b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:01.555377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-538a97e2-40a0-4a41-a6de-a09552d5b6cf None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:01.566251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-538a97e2-40a0-4a41-a6de-a09552d5b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:01.566251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:01.602619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1670ca-0896-4455-8040-55ff45ebcd2d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:01.613846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1670ca-0896-4455-8040-55ff45ebcd2d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:01.617347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:01.617982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:01.618261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:01.618535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:01.627785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:01.629596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4f56d-b1b2-4f87-9d0d-7cc3a76787f1 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:01.638968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 717/1446] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:04.196579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403863-3d48-415a-aa8e-1aa31182ac7d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:04.197169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403863-3d48-415a-aa8e-1aa31182ac7d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:04.197169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403863-3d48-415a-aa8e-1aa31182ac7d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:04.198518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:04.204148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92faeb-f5b4-4e7c-9c67-117256fa4e0d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:04.204650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92faeb-f5b4-4e7c-9c67-117256fa4e0d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:04.204756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92faeb-f5b4-4e7c-9c67-117256fa4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:04.221767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8f92faeb-f5b4-4e7c-9c67-117256fa4e0d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:04.222948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8f92faeb-f5b4-4e7c-9c67-117256fa4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:04.230735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:04.269458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403863-3d48-415a-aa8e-1aa31182ac7d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:04.279708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403863-3d48-415a-aa8e-1aa31182ac7d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:04.283389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:04.284025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:04.284310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:04.284618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:04.293490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:04.295420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2416c-21a5-4477-857a-c23761bd95ad service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:04.304831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 731/1449] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:06.647494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c85-aea5-465f-8948-029a66724e82 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:06.648032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c85-aea5-465f-8948-029a66724e82 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:06.648032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c85-aea5-465f-8948-029a66724e82 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:06.649359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:06.654506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787932-720a-4aca-942b-08ad9cccc6d4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:06.654882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787932-720a-4aca-942b-08ad9cccc6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:06.655076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98787932-720a-4aca-942b-08ad9cccc6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:06.672644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-98787932-720a-4aca-942b-08ad9cccc6d4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:06.673824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-98787932-720a-4aca-942b-08ad9cccc6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:06.681966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:06.719422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c18c85-aea5-465f-8948-029a66724e82 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:06.729794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c18c85-aea5-465f-8948-029a66724e82 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:06.733771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:06.734411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:06.734694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:06.734970 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:06.743978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:06.745486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00838fe-3367-4c45-9dff-c45d85351c48 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:06.755352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 720/1452] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:09.025347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d82dc-e78e-4213-9df8-fd11dd04356f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:09.025922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d82dc-e78e-4213-9df8-fd11dd04356f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:09.025922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d82dc-e78e-4213-9df8-fd11dd04356f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:09.027280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:09.032575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3b60-7a86-4be6-b9cc-aa35a476cf49 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:09.032996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3b60-7a86-4be6-b9cc-aa35a476cf49 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:09.033107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3b60-7a86-4be6-b9cc-aa35a476cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:09.050789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b62a3b60-7a86-4be6-b9cc-aa35a476cf49 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:09.051951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b62a3b60-7a86-4be6-b9cc-aa35a476cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:09.059485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:18:09.097613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d82dc-e78e-4213-9df8-fd11dd04356f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:09.108394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d82dc-e78e-4213-9df8-fd11dd04356f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:09.111857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:09.112531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:09.112812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:09.113193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:09.121684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:09.123727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33cef8-66a9-41ba-904f-73a13e0b9f98 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:09.132701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 734/1455] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:11.412941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fcb9-010d-44ad-8d55-af0f1639cd34 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:11.413488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fcb9-010d-44ad-8d55-af0f1639cd34 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:11.413488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fcb9-010d-44ad-8d55-af0f1639cd34 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:11.414841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:11.419926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836c71-6472-42c1-a2e3-a4fb85905e82 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:11.420350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836c71-6472-42c1-a2e3-a4fb85905e82 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:11.421089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836c71-6472-42c1-a2e3-a4fb85905e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:11.438554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-96836c71-6472-42c1-a2e3-a4fb85905e82 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:11.439808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96836c71-6472-42c1-a2e3-a4fb85905e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:11.447421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:11.484820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118fcb9-010d-44ad-8d55-af0f1639cd34 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:11.495167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118fcb9-010d-44ad-8d55-af0f1639cd34 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:11.498661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:11.499289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:11.499570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:11.499842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:11.508453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:11.509862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916b1bd-6b47-42f1-aea2-a79f33ebc795 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:11.518934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 723/1458] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:13.804228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21dfd-367d-4201-8e67-cc899a1a09ed None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:13.804721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21dfd-367d-4201-8e67-cc899a1a09ed None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:13.804868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21dfd-367d-4201-8e67-cc899a1a09ed None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:13.806235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:13.811369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3de-ee8c-4f68-8dd5-d1fa60dcaa11 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:13.811817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3de-ee8c-4f68-8dd5-d1fa60dcaa11 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:13.811915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3de-ee8c-4f68-8dd5-d1fa60dcaa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:13.829074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ce72b3de-ee8c-4f68-8dd5-d1fa60dcaa11 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:13.830271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ce72b3de-ee8c-4f68-8dd5-d1fa60dcaa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:13.837907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:13.875161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef21dfd-367d-4201-8e67-cc899a1a09ed None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:13.885519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef21dfd-367d-4201-8e67-cc899a1a09ed None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:13.888982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:13.889603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:13.889886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:13.890166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:13.898898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:13.900698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5200f7-a411-4d2a-981c-618237424b65 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:13.910368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 737/1461] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:16.187569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e2af-09ed-4d4c-bda9-1968a0a92db3 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:16.188097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e2af-09ed-4d4c-bda9-1968a0a92db3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:16.188097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e2af-09ed-4d4c-bda9-1968a0a92db3 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:16.189511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:16.194917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353b2-d621-4025-8d48-89f3eebea7c2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:16.195356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353b2-d621-4025-8d48-89f3eebea7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:16.195477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353b2-d621-4025-8d48-89f3eebea7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:16.214032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4e6353b2-d621-4025-8d48-89f3eebea7c2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:16.215199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e6353b2-d621-4025-8d48-89f3eebea7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:16.223101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:16.259714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e2af-09ed-4d4c-bda9-1968a0a92db3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:16.270738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e2af-09ed-4d4c-bda9-1968a0a92db3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:16.274240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:16.274867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:16.275141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:16.275419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:16.283985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:16.285440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3b4aa-9625-443d-bf8f-cf9f3198b8f0 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:16.295015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 726/1464] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:18.627062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab04-8775-43a2-86f0-ba926ff8d93c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:18.627576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab04-8775-43a2-86f0-ba926ff8d93c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:18.627576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6ab04-8775-43a2-86f0-ba926ff8d93c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:18.628920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:18.634044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81498-5a63-4667-b482-a515d2dbe08b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:18.634437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81498-5a63-4667-b482-a515d2dbe08b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:18.634595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81498-5a63-4667-b482-a515d2dbe08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:18.652350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-57d81498-5a63-4667-b482-a515d2dbe08b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:18.653547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-57d81498-5a63-4667-b482-a515d2dbe08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:18.661203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:18.698197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6ab04-8775-43a2-86f0-ba926ff8d93c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:18.708684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6ab04-8775-43a2-86f0-ba926ff8d93c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:18.712285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:18.712933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:18.713231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:18.713483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:18.722065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:18.723474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f147c-00ce-46ed-bab6-94b86bb725af service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:18.733149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 740/1467] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:20.965248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736a3-cb7e-4e5c-9665-d0ce7b3d013d None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:20.966425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736a3-cb7e-4e5c-9665-d0ce7b3d013d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:20.966425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736a3-cb7e-4e5c-9665-d0ce7b3d013d None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:20.967643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:20.972823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde7eb-d91d-4f2c-a478-f444c32c010c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:20.973254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde7eb-d91d-4f2c-a478-f444c32c010c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:20.973379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde7eb-d91d-4f2c-a478-f444c32c010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:20.990741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-75fde7eb-d91d-4f2c-a478-f444c32c010c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:20.991932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-75fde7eb-d91d-4f2c-a478-f444c32c010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:20.999650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:21.036103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7736a3-cb7e-4e5c-9665-d0ce7b3d013d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:21.046406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7736a3-cb7e-4e5c-9665-d0ce7b3d013d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:21.050136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:21.050772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:21.051046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:21.051316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:21.060480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:21.061917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42d8fb-7d86-49ac-aa7d-bb2f9b68e74a service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:21.071802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 729/1470] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:18:54.939380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890bdb6-09be-4895-adde-1f3d962a41bb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:54.940007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890bdb6-09be-4895-adde-1f3d962a41bb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:54.940007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890bdb6-09be-4895-adde-1f3d962a41bb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:54.941297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 742/1471] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:54.946467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7a9e-ceda-40a7-ba84-01d08d4742ce None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:54.946955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7a9e-ceda-40a7-ba84-01d08d4742ce None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:54.947059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7a9e-ceda-40a7-ba84-01d08d4742ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:54.964515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-cf9b7a9e-ceda-40a7-ba84-01d08d4742ce None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:54.965678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cf9b7a9e-ceda-40a7-ba84-01d08d4742ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:54.973268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 730/1472] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:55.018522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598512af-2b94-4c84-8e98-7321adb39a1d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:55.018810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598512af-2b94-4c84-8e98-7321adb39a1d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:55.019087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598512af-2b94-4c84-8e98-7321adb39a1d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:55.020452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 743/1473] 10.222.0.21 () {54 vars in 962 bytes} [Tue May 3 12:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:55.025168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6271-0188-4a34-8165-551c87c5afaf None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:55.025454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6271-0188-4a34-8165-551c87c5afaf None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:55.025816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6271-0188-4a34-8165-551c87c5afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:55.044155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-fbfe6271-0188-4a34-8165-551c87c5afaf None None] MFA Rules not processed for user `e0e3a64bbcfa4449b4aba61a201c1c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:55.045371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fbfe6271-0188-4a34-8165-551c87c5afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:55.051881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 731/1474] 10.222.0.21 () {58 vars in 1059 bytes} [Tue May 3 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:55.058930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598512af-2b94-4c84-8e98-7321adb39a1d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:55.069118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598512af-2b94-4c84-8e98-7321adb39a1d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:55.072554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:55.073199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:55.073475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:55.073744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:55.082178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:55.083575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58b5e4-5183-4695-b812-fe4956b5be9a service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:55.093139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 744/1475] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:18:57.405032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d7f5-940a-4b57-871e-51ea2bfcac45 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:57.405553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d7f5-940a-4b57-871e-51ea2bfcac45 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:57.405553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d7f5-940a-4b57-871e-51ea2bfcac45 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:57.406947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 732/1476] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:57.412308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4dfef-ebda-43fc-8ef5-1391c0feb8fd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:57.414964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4dfef-ebda-43fc-8ef5-1391c0feb8fd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:57.414964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4dfef-ebda-43fc-8ef5-1391c0feb8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:57.431417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5bc4dfef-ebda-43fc-8ef5-1391c0feb8fd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:57.432679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5bc4dfef-ebda-43fc-8ef5-1391c0feb8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:57.440420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 745/1477] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:57.464298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d7f5-940a-4b57-871e-51ea2bfcac45 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:57.476674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d7f5-940a-4b57-871e-51ea2bfcac45 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:57.481653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:57.482289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:57.482564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:57.482836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:57.483550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:57.485326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:18:57.485326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:18:57.485326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:18:57.486485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc823250-01cd-499f-935f-31140388f960 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:57.504939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 733/1478] 10.222.0.21 () {56 vars in 1108 bytes} [Tue May 3 12:18:57 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:18:59.740882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d8fe-79ba-4ae2-b3e1-18dadcd84bf0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:59.741400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d8fe-79ba-4ae2-b3e1-18dadcd84bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:59.741400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d8fe-79ba-4ae2-b3e1-18dadcd84bf0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:59.742719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 746/1479] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:18:59.747790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5c1b-a835-436b-be8f-634d296fe996 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:59.748261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5c1b-a835-436b-be8f-634d296fe996 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:59.748405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5c1b-a835-436b-be8f-634d296fe996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:59.766225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c88d5c1b-a835-436b-be8f-634d296fe996 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:18:59.767419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c88d5c1b-a835-436b-be8f-634d296fe996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:18:59.775282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 734/1480] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:18:59.816352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d8fe-79ba-4ae2-b3e1-18dadcd84bf0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:18:59.830762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d8fe-79ba-4ae2-b3e1-18dadcd84bf0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:18:59.836001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:18:59.836656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:18:59.836935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:18:59.837205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:18:59.845554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:18:59.847103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a3c-ea07-4654-81f4-f6e2c9b99262 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:18:59.856336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 747/1481] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:19:02.252575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d94d1-cee7-467e-8ded-45f45b42e27c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:02.253121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d94d1-cee7-467e-8ded-45f45b42e27c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:02.253121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d94d1-cee7-467e-8ded-45f45b42e27c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:02.254495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 735/1482] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:19:02.259527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26751-0e0d-435e-af3f-b97bfb59b3e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:02.259955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26751-0e0d-435e-af3f-b97bfb59b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:02.260082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26751-0e0d-435e-af3f-b97bfb59b3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:02.277226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eee26751-0e0d-435e-af3f-b97bfb59b3e8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:19:02.278399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eee26751-0e0d-435e-af3f-b97bfb59b3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:19:02.286026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 748/1483] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:19:02.321998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d94d1-cee7-467e-8ded-45f45b42e27c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:19:02.332388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d94d1-cee7-467e-8ded-45f45b42e27c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:19:02.335886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:19:02.336575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:02.336839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:02.337112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:02.346064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:19:02.347483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d576c4-419b-4a0a-aa09-5f4ab8cbb544 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:19:02.357140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 736/1484] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:19:04.663390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1b544-2eb8-4c2c-8c99-2c688ec41156 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:04.663952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1b544-2eb8-4c2c-8c99-2c688ec41156 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:04.663952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1b544-2eb8-4c2c-8c99-2c688ec41156 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:04.665291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 749/1485] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:19:04.670441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec2f4-5898-470c-91e6-15f0ee81a71e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:04.670900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec2f4-5898-470c-91e6-15f0ee81a71e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:04.671003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec2f4-5898-470c-91e6-15f0ee81a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:04.688655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-981ec2f4-5898-470c-91e6-15f0ee81a71e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:19:04.689812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-981ec2f4-5898-470c-91e6-15f0ee81a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:19:04.697378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 737/1486] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:19:04.734869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1b544-2eb8-4c2c-8c99-2c688ec41156 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:19:04.745610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1b544-2eb8-4c2c-8c99-2c688ec41156 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:19:04.749077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:19:04.749725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:04.750002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:04.750269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:04.758751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:19:04.760699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ab8b-ca35-4fe2-8f5d-66f95a7e229f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:19:04.769667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 750/1487] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:19:07.089008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20e27-26bc-46af-988b-f2c640b4e56e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:07.089579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20e27-26bc-46af-988b-f2c640b4e56e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:07.089579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20e27-26bc-46af-988b-f2c640b4e56e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:07.090913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 738/1488] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:19:07.096252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e8c10-7696-45a7-909f-b0c7c9b48fce None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:07.096720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e8c10-7696-45a7-909f-b0c7c9b48fce None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:07.096832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e8c10-7696-45a7-909f-b0c7c9b48fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:07.115284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ae6e8c10-7696-45a7-909f-b0c7c9b48fce None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:19:07.116490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae6e8c10-7696-45a7-909f-b0c7c9b48fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:19:07.124274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 751/1489] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:19:07.164167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d20e27-26bc-46af-988b-f2c640b4e56e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:19:07.175286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d20e27-26bc-46af-988b-f2c640b4e56e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:19:07.178676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:19:07.179299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:07.179574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:07.179843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:07.188259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:19:07.189692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc125e-fd07-4ebb-977f-3fc92ddf6f32 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:19:07.198575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 739/1490] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:19:09.880469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f828c1-13a3-4864-9f9e-542947be0d3b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:09.881003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f828c1-13a3-4864-9f9e-542947be0d3b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:09.881003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f828c1-13a3-4864-9f9e-542947be0d3b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:09.882363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 752/1491] 10.222.0.21 () {54 vars in 926 bytes} [Tue May 3 12:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:19:09.888229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9695-1e21-4d01-94a1-e365786b66c7 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:09.888647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9695-1e21-4d01-94a1-e365786b66c7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:09.888831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9695-1e21-4d01-94a1-e365786b66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:09.906400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3ecf9695-1e21-4d01-94a1-e365786b66c7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:19:09.907581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3ecf9695-1e21-4d01-94a1-e365786b66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:19:09.915368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 740/1492] 10.222.0.21 () {58 vars in 1023 bytes} [Tue May 3 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:19:09.954233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f828c1-13a3-4864-9f9e-542947be0d3b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:19:09.964422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f828c1-13a3-4864-9f9e-542947be0d3b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:19:09.968038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:19:09.968696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:19:09.968976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:19:09.969249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:19:09.977992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:19:09.979405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb516a5-204b-4b74-98f6-8a1d77c58487 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:19:09.988506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 753/1493] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:20:46.466348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.466955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.466955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.484085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:20:46.485290 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:46.492996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 741/1494] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:20:46.500648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.501107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.501210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.518837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:20:46.520004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:46.528269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 754/1495] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:20:46.532598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.541704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f4c3-765a-4ad3-b555-81e6648ff7b2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.546065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.546701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.546980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.547253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.548231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:20:46.548570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.549568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.549568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:20:46.549568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:20:46.550432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:46.561400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 742/1496] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:20:46.569733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.578652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939556f8-5c9d-40a5-b316-dcd0783b87ae None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.583175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.583814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.584730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.585009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.585697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.587458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.587458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:20:46.587458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:20:46.588679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:46.730096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 755/1497] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:20:46 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:20:46.734276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.744317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62c41-5d93-4f77-a5ba-747c596470bb admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.796343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.797025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.797566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.797837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.798526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.799532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.799532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:20:46.799532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:20:46.800745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:46.863424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 743/1498] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:20:46 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:20:46.868082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.877973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b6c-e2fa-4ad4-8c25-fb0e5dc6c24f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.883017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.883661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.883939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.884208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.884950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.885956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.885956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:20:46.885956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:20:46.886830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:46.899077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 756/1499] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:20:46.902916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.912268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfd4-74f4-48e9-8c37-8b6899515ad2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.916703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.917493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.917773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.918049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.918763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.919764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.919764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:20:46.919764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:20:46.920653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eab1d-f764-472c-aa3e-159724ddcf1e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:46.934396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 744/1500] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:20:46.938277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:46.948343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8f04-2f80-4d97-b272-2f44d9718b6c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:46.952844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:46.953702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:46.953982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:46.954252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] PATH_INFO: `/v3/projects/216b0689f404406ebe0b1d211d519371/users/1dacd3a0c6254437b23f71cf38f51574/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:46.969873 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216b0689f404406ebe0b1d211d519371, user_id=1dacd3a0c6254437b23f71cf38f51574, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:46.970888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:46.970888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:20:46.970888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:20:46.972867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:47.035314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 757/1501] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:20:46 2022] PUT /identity/v3/projects/216b0689f404406ebe0b1d211d519371/users/1dacd3a0c6254437b23f71cf38f51574/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:20:47.047503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75fb5-4b38-43ab-beaf-a29297065c78 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.047797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75fb5-4b38-43ab-beaf-a29297065c78 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.048067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75fb5-4b38-43ab-beaf-a29297065c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.073308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4af75fb5-4b38-43ab-beaf-a29297065c78 None None] MFA Rules not processed for user `1dacd3a0c6254437b23f71cf38f51574`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:20:47.074484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4af75fb5-4b38-43ab-beaf-a29297065c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:47.134289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 745/1502] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:20:47.145044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:47.211672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b58118-66ff-4677-a086-9fe2c54083e1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:47.216997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:47.217622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.217899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.218168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.225587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:47.227140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:47.235451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 758/1503] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:20:47.306068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688741-597f-4a7f-ab5c-4fce4ea83198 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.306356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688741-597f-4a7f-ab5c-4fce4ea83198 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.306632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688741-597f-4a7f-ab5c-4fce4ea83198 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.307906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 746/1504] 10.222.0.21 () {52 vars in 829 bytes} [Tue May 3 12:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:20:47.311429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:47.371276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3091b08-f502-4af5-abd0-811874c5040e service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:47.375803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:47.376699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.376985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.377259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] PATH_INFO: `/v3/users/1dacd3a0c6254437b23f71cf38f51574` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.378431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dacd3a0c6254437b23f71cf38f51574)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:47.379441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:47.379441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:20:47.379441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:20:47.380677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:47.586732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dacd3a0c6254437b23f71cf38f51574'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:47.587485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dacd3a0c6254437b23f71cf38f51574'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:47.599785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dacd3a0c6254437b23f71cf38f51574'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:47.720832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dacd3a0c6254437b23f71cf38f51574'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:47.738843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dacd3a0c6254437b23f71cf38f51574'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:47.745439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 759/1505] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:20:47 2022] DELETE /identity/v3/users/1dacd3a0c6254437b23f71cf38f51574 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:20:47.749816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.753253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.753253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.768910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:20:47.770098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:47.827466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 747/1506] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:20:47.837199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:47.838537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:47.893623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508ae3f-e129-4d30-b5cf-093a520af61d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:47.897167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:47.897806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:47.898082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:47.898353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:47.906975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:47.908398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da674-5f62-4048-b402-48fedf47b54e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:47.917976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 760/1507] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:20:48.362761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:20:48.364202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:20:48.375908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a9ec-4d70-4c4e-ad80-f6252e794ad5 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:20:48.382047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:20:48.382978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:20:48.383260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:20:48.383535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] PATH_INFO: `/v3/projects/216b0689f404406ebe0b1d211d519371` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:20:48.384769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216b0689f404406ebe0b1d211d519371)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:20:48.385791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:20:48.385791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:20:48.385791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:20:48.387215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:20:48.525901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216b0689f404406ebe0b1d211d519371', 'request_id': 'req-767f3b2c-d426-423c-8ffb-8f3ae22dea57'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:48.538674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216b0689f404406ebe0b1d211d519371', 'request_id': 'req-767f3b2c-d426-423c-8ffb-8f3ae22dea57'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:48.544486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216b0689f404406ebe0b1d211d519371', 'request_id': 'req-767f3b2c-d426-423c-8ffb-8f3ae22dea57'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:48.625470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] The token cache is being invalidate because project 216b0689f404406ebe0b1d211d519371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:20:48.625760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:48.626422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-767f3b2c-d426-423c-8ffb-8f3ae22dea57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:20:48.628052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 748/1508] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:20:48 2022] DELETE /identity/v3/projects/216b0689f404406ebe0b1d211d519371 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:22:28.418673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:28.419308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:28.419308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:28.420647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 761/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:28.425848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067daeb-5068-40a8-bb80-f262efb3ce7a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:28.426250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067daeb-5068-40a8-bb80-f262efb3ce7a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:28.426401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067daeb-5068-40a8-bb80-f262efb3ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:28.444461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a067daeb-5068-40a8-bb80-f262efb3ce7a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:28.445644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a067daeb-5068-40a8-bb80-f262efb3ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:28.500337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 749/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:28.653213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:28.654934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:28.684160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2a70-e8fb-4a20-941c-857dd9e0ec91 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:28.684472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2a70-e8fb-4a20-941c-857dd9e0ec91 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:28.684752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2a70-e8fb-4a20-941c-857dd9e0ec91 None None] PATH_INFO: `/v3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:28.686086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 750/1511] 10.222.0.39 () {54 vars in 925 bytes} [Tue May 3 12:22:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:22:28.692056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151a18-bada-472c-8288-7681ce97ea96 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:28.692375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151a18-bada-472c-8288-7681ce97ea96 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:28.692650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151a18-bada-472c-8288-7681ce97ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:28.710894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-89151a18-bada-472c-8288-7681ce97ea96 None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:28.712075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-89151a18-bada-472c-8288-7681ce97ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:28.735334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fd615-5639-45ec-b606-b044aecca3a7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:28.741245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:28.741887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:28.742168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:28.742446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:28.750296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:28.752546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9c1d5-94c9-41fb-8b3a-9c3aa79f3e4a service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:28.762021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 762/1512] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:28.771757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 751/1513] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 3 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:22:29.973257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99326-34ad-4a3f-a31a-c52ed32b9eac None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:29.973838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99326-34ad-4a3f-a31a-c52ed32b9eac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:29.973838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99326-34ad-4a3f-a31a-c52ed32b9eac None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:29.975146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:29.981162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00043bd-ca25-4da4-8c5b-51040fe1c160 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:29.981635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00043bd-ca25-4da4-8c5b-51040fe1c160 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:29.981764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00043bd-ca25-4da4-8c5b-51040fe1c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:29.999334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f00043bd-ca25-4da4-8c5b-51040fe1c160 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:30.000520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f00043bd-ca25-4da4-8c5b-51040fe1c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:30.008705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:30.157796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99326-34ad-4a3f-a31a-c52ed32b9eac None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:30.171983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99326-34ad-4a3f-a31a-c52ed32b9eac None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:30.178232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:30.178875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:30.179157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:30.179431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:30.187495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:30.189745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f52f7-caa5-4273-8058-250e7cb7ac03 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:30.198956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 764/1516] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:37.985196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a180b-4971-4e6f-bb7f-47d78da60523 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:37.986342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a180b-4971-4e6f-bb7f-47d78da60523 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:37.986460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a180b-4971-4e6f-bb7f-47d78da60523 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:37.987818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 753/1517] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:37.993687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3276-44b5-4d00-b2c2-8cf65c4582ba None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:37.994375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3276-44b5-4d00-b2c2-8cf65c4582ba None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:37.994375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3276-44b5-4d00-b2c2-8cf65c4582ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:38.011814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d4ed3276-44b5-4d00-b2c2-8cf65c4582ba None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:38.013068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d4ed3276-44b5-4d00-b2c2-8cf65c4582ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:38.021651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 765/1518] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:38.029087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a180b-4971-4e6f-bb7f-47d78da60523 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:38.042576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a180b-4971-4e6f-bb7f-47d78da60523 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:38.047690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:38.048988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:38.049270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:38.049547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:38.057657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:38.059211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df103ac-16ec-40d8-98bd-ab06bf724762 service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:38.068615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 754/1519] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:41.843976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193496-6cf7-4614-9efe-a84a5bb9944d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:41.844673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193496-6cf7-4614-9efe-a84a5bb9944d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:41.844673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193496-6cf7-4614-9efe-a84a5bb9944d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:41.845934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 766/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:41.850755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d406ba6-4599-4e09-a5ed-86389dfa0a62 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:41.854801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d406ba6-4599-4e09-a5ed-86389dfa0a62 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:41.854801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d406ba6-4599-4e09-a5ed-86389dfa0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:41.868799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7d406ba6-4599-4e09-a5ed-86389dfa0a62 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:41.869956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7d406ba6-4599-4e09-a5ed-86389dfa0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:41.878167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 755/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:42.029306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193496-6cf7-4614-9efe-a84a5bb9944d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:42.043397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193496-6cf7-4614-9efe-a84a5bb9944d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:42.049001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:42.049733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:42.050008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:42.050277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:42.058153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:42.061024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90bc2-f774-437b-b4b7-df42ad10226e service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:42.069761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 767/1522] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:43.280213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ce24-c3cf-444d-897f-87958b0b2a19 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:43.280826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ce24-c3cf-444d-897f-87958b0b2a19 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:43.280826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ce24-c3cf-444d-897f-87958b0b2a19 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:43.282195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 756/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 12:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:43.287450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aaa3d-13d3-45f4-8510-e11ececc8d6a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:43.287902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aaa3d-13d3-45f4-8510-e11ececc8d6a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:43.288078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aaa3d-13d3-45f4-8510-e11ececc8d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:43.305656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-491aaa3d-13d3-45f4-8510-e11ececc8d6a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:43.306833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-491aaa3d-13d3-45f4-8510-e11ececc8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:43.315031 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 768/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 12:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:43.464573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218ce24-c3cf-444d-897f-87958b0b2a19 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:43.478428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218ce24-c3cf-444d-897f-87958b0b2a19 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:43.483729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:43.484351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:43.484656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:43.484928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:43.492785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:43.494394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91cd8a-6f6c-4596-8ca1-c8fd545ff93b service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:43.504085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 757/1525] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:47.568662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:47.569205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:47.569205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:47.570621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 769/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:47.575846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfe769-7f9f-4e5c-8e3c-af0a5df5ce2e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:47.576252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfe769-7f9f-4e5c-8e3c-af0a5df5ce2e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:47.576501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfe769-7f9f-4e5c-8e3c-af0a5df5ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:47.595095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-52cfe769-7f9f-4e5c-8e3c-af0a5df5ce2e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:47.598892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-52cfe769-7f9f-4e5c-8e3c-af0a5df5ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:47.603922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 758/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:47.639262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:47.640961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:47.697497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67199a3-ddcb-47dd-9692-6affb56aadd8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:47.701370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:47.702010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:47.702288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:47.702562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:47.711819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:47.713293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c47a5-cd11-4079-8b9d-63d24ee8925f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:47.722397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 770/1528] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:49.952061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c97-09d4-41f8-ba29-eb527e91b48e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:49.952569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c97-09d4-41f8-ba29-eb527e91b48e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:49.952673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c97-09d4-41f8-ba29-eb527e91b48e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:49.954044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 759/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:49.959248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b3e5-3a2c-4135-aa82-927ed260088f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:49.959674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b3e5-3a2c-4135-aa82-927ed260088f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:49.959831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b3e5-3a2c-4135-aa82-927ed260088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:49.977995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7964b3e5-3a2c-4135-aa82-927ed260088f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:49.979173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7964b3e5-3a2c-4135-aa82-927ed260088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:49.987484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 771/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:50.021931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56c97-09d4-41f8-ba29-eb527e91b48e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:50.032904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56c97-09d4-41f8-ba29-eb527e91b48e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:50.036549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:50.037199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:50.037473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:50.037743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:50.046686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:50.048755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edfae1-ea83-4e9b-95d0-b45f063beebb service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:50.057852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 760/1531] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:53.835689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:53.836233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:53.836233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:53.837625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 772/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:53.842835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a491bb-bf2d-498a-856c-848f875c32c2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:53.843268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a491bb-bf2d-498a-856c-848f875c32c2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:53.843402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a491bb-bf2d-498a-856c-848f875c32c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:53.862143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c3a491bb-bf2d-498a-856c-848f875c32c2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:53.863308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c3a491bb-bf2d-498a-856c-848f875c32c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:53.870926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 761/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:54.151380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:54.153032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:54.209405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fca84c-5c42-47aa-a793-4174ea0782a5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:54.212929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:54.213577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:54.213860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:54.214134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:54.222869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:54.224298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff9ae1-ff3c-4a8b-830f-6efc70c69f09 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:54.233659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 773/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:22:56.498111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263af3-477f-4c88-a05b-c35218e6451f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:56.498673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263af3-477f-4c88-a05b-c35218e6451f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:56.498673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263af3-477f-4c88-a05b-c35218e6451f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:56.500008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 762/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 12:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:56.505661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebb83-18f6-47fe-b231-6b6f8cab62c7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:56.506109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebb83-18f6-47fe-b231-6b6f8cab62c7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:56.506225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebb83-18f6-47fe-b231-6b6f8cab62c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:56.527249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6dcebb83-18f6-47fe-b231-6b6f8cab62c7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:56.528478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6dcebb83-18f6-47fe-b231-6b6f8cab62c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:56.536213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 774/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:56.813813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2153-ef50-41e6-b406-b2d64051f48a None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:56.814097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2153-ef50-41e6-b406-b2d64051f48a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:56.814370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2153-ef50-41e6-b406-b2d64051f48a None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:56.815735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 763/1537] 10.222.0.21 () {54 vars in 963 bytes} [Tue May 3 12:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:22:56.820471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3027c-9d18-4d41-a41d-0649ebb196ed None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:56.820758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3027c-9d18-4d41-a41d-0649ebb196ed None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:56.821029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3027c-9d18-4d41-a41d-0649ebb196ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:56.838238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-67b3027c-9d18-4d41-a41d-0649ebb196ed None None] MFA Rules not processed for user `f8055b211f0f48ee89f209dacd33837c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:22:56.839387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-67b3027c-9d18-4d41-a41d-0649ebb196ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:22:56.846175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 775/1538] 10.222.0.21 () {58 vars in 1060 bytes} [Tue May 3 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:22:56.853352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2153-ef50-41e6-b406-b2d64051f48a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:22:56.865561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2153-ef50-41e6-b406-b2d64051f48a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:22:56.869180 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:22:56.869799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:22:56.870076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:22:56.870395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:22:56.879035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:22:56.880479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017e4dd-7e29-4935-b23f-5d4193ace678 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:22:56.889749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 764/1539] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:24:26.299504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781e5b-7434-42d9-a3e1-3e2223a94630 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.300162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781e5b-7434-42d9-a3e1-3e2223a94630 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.300162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781e5b-7434-42d9-a3e1-3e2223a94630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.332289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-09781e5b-7434-42d9-a3e1-3e2223a94630 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.333521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-09781e5b-7434-42d9-a3e1-3e2223a94630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.349022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 776/1540] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.359467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c83c-c439-49ea-9697-1f52eadc1662 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.360602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c83c-c439-49ea-9697-1f52eadc1662 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.361144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7c83c-c439-49ea-9697-1f52eadc1662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.381093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.381784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.382429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.391296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b7b7c83c-c439-49ea-9697-1f52eadc1662 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.392845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b7b7c83c-c439-49ea-9697-1f52eadc1662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.414657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 765/1541] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.415696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.417127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.422650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e777-f7dc-4292-a109-65172f93c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.422650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e777-f7dc-4292-a109-65172f93c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.422650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542e777-f7dc-4292-a109-65172f93c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.435396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 777/1542] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:26.437110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.448454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a606f-1b74-4054-8b0f-a056e6ef9358 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.455113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8542e777-f7dc-4292-a109-65172f93c4f6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.456473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8542e777-f7dc-4292-a109-65172f93c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.457384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.458060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.458334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.458600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.459386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:26.459686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.461125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:26.461125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:24:26.461125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:24:26.462024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59dece-72ac-48f1-a74d-1d8db3ab3b6f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.482320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 766/1543] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:26.483704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587def6-8c81-4812-b062-ef13a81996a4 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.483987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587def6-8c81-4812-b062-ef13a81996a4 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.484262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587def6-8c81-4812-b062-ef13a81996a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.488844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 778/1544] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:26.490167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.492429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.492711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.523737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1587def6-8c81-4812-b062-ef13a81996a4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.525154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1587def6-8c81-4812-b062-ef13a81996a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.526882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.528024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.540943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 767/1545] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.544604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096c1-b679-4fd4-9847-349da9afcf54 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.544892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096c1-b679-4fd4-9847-349da9afcf54 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.545166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096c1-b679-4fd4-9847-349da9afcf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.549706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 779/1546] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.550463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.565922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54dbc-68a7-44d1-9c68-129a3790d1ef None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.574187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-565096c1-b679-4fd4-9847-349da9afcf54 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.574387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.574870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.575674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.575927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-565096c1-b679-4fd4-9847-349da9afcf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.576049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.576658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.578597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c74030-5212-4e9c-a5ef-c34bcb95e37b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.583986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 768/1547] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.585413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989480-7fec-48d8-82a6-f7f2edce9245 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.585704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989480-7fec-48d8-82a6-f7f2edce9245 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.585978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989480-7fec-48d8-82a6-f7f2edce9245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.603939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-91989480-7fec-48d8-82a6-f7f2edce9245 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.605149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-91989480-7fec-48d8-82a6-f7f2edce9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.612914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 769/1548] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.619677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.619677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.619677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.632909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.634090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.642407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 770/1549] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.643171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.652522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89c73-9e1c-4e0e-9bc4-e4d9ad02f735 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.657739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.658405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.658686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.658960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.659690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:26.660002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.661626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8fad-716f-4f82-bf81-1333887f1cbb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.666865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 780/1550] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:26.667037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.667288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.670690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.673791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 771/1551] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:26.675249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6bd59-d207-41eb-976e-58208d6e635d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.675717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6bd59-d207-41eb-976e-58208d6e635d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.675997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6bd59-d207-41eb-976e-58208d6e635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.693053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.693767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b7a6bd59-d207-41eb-976e-58208d6e635d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.694255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.694909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b7a6bd59-d207-41eb-976e-58208d6e635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.750673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 772/1552] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.750896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 781/1553] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.751632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.751932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646519-fe2a-4b9f-9a7f-176fb5b1a05e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.752213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646519-fe2a-4b9f-9a7f-176fb5b1a05e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.752517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646519-fe2a-4b9f-9a7f-176fb5b1a05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.769519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4385-e9d1-4208-8008-0779e88879e7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.771194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e3646519-fe2a-4b9f-9a7f-176fb5b1a05e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.772440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e3646519-fe2a-4b9f-9a7f-176fb5b1a05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.774164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.774877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.775158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.775432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.776166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:26.776499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.778164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.780454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 773/1554] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.781661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.781944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.782217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.790560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 782/1555] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:26.791665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.800060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.801186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.803815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e1996-f134-493e-950e-1416cbf26ed3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.808232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.809003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 774/1556] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.809134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.809227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.809940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.810115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.810755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:26.811061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.812656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.818848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb77566-efa5-43c8-993a-8806aea5e6b0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.823438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.824282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.824662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.824813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 783/1557] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:26.825056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.826008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:26.826393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.828291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162581ac-d770-4bb9-9031-6aabd94c793b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.835216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744ba8-5d21-42e4-9910-ec85826ccd09 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:26.839751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:26.840402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.841223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.841493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.842433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:26.844336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fa9ba-31f6-49bc-83dc-a9b7415fc9ed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:26.887100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 775/1558] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/users => generated 292 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:26.888671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fdc23-150c-4cb1-a2b2-6f5c1be766ad None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.889167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fdc23-150c-4cb1-a2b2-6f5c1be766ad None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.889541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fdc23-150c-4cb1-a2b2-6f5c1be766ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.907310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c78fdc23-150c-4cb1-a2b2-6f5c1be766ad None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.908534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c78fdc23-150c-4cb1-a2b2-6f5c1be766ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.916159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 776/1559] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.917398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.917689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.917964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.937361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 784/1560] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:26.938638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.938820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:26.939111 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:26.939382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:26.939825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.958674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:26.958674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:26.997182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 777/1561] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:26.997779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.006458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b1c58-4994-425f-a48a-a6a907ab23fa None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.010961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.011603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.011883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.012151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.012862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.013868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:27.013868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:24:27.013868 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:24:27.015024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.018545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 785/1562] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:27.019364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.028014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1236f1-f750-4e36-8569-fa62b1b12641 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.033467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.034111 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.034388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.034655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.035380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:27.035678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.037321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.049162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 786/1563] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:27.049900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.058688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a115e9-eee2-4931-8948-a692020fba86 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.063040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.065827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.065827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.065827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.065827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.066760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.114950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 778/1564] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:26 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.115777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.146735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 787/1565] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.146735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.174663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c6b11-9246-46d3-9d40-0c3aba77ff81 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.209550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f194b-7a0e-4b04-95a1-8417378935a3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.214066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.214724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.215007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.215309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.216753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:27.217081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.218660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.230083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 788/1566] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:27.230963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.233223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.234038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.234316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.234586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.235309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.237076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.240222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782830b1-5e18-49cb-bb2c-9597007b32a5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.244721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.245366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.245641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.245910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.246580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.246983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 779/1567] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:27.247827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.250665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:27.250665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:24:27.250665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:24:27.251862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.256957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593646e6-4b16-41b0-8cfc-8f680ff8df13 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.261874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.263118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.263396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.263668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.264414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:27.264724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.266343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.278866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 780/1568] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:27.279812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.292952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfacfb-4eb2-4b17-97f0-4e475bf59baa admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.298776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.304156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.314236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 781/1569] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:27.315102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.324600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853e17-8a26-4f87-8917-7fac75003d79 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.329718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.330390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 789/1570] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.330887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.330887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.331052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.331128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.334266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.334266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.345887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455227-3bd8-401d-89fd-ea681c0a7226 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.351437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.352102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.352402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.352741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.353504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.355412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.408117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 782/1571] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.408992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.437406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 790/1572] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.437406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.446380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843962d-8e11-493d-b2f4-0f7fcafba094 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.468206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e018e4-4caf-47e8-a23a-8ae35a27c190 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.472720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.473409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.473767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.474035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.474714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.476729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.500242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.502094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.502094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.502094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.502455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.504009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.595560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 783/1573] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.596693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.606290 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008d4eb-f625-478b-a0f5-4310ceca1c90 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.610775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.611474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.611747 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.612015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.612750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.614307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.624262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 784/1574] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:27.625113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.625680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 791/1575] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.626492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.638270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03a08-44c8-470d-89f4-7defe6b48d2c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.684965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb159c-7189-4c3c-803d-e8856c53081c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.689654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.690304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.690582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.690850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.691060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.691522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.691712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.691994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.692269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.692969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.693542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.694855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.785325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 792/1576] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.786148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.797723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 785/1577] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.798709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.849070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de33c-a1cd-4b0b-88c1-f1852b04201c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.857872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec389-9b91-4d05-87d7-9b07587f7121 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.862786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.863449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.863735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.864006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.864746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.866658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.901113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.901763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.902047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.902316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.903015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.905278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.914518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 793/1578] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:27.917554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.924688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e456a1-b953-4510-ac0a-aceba9a60f84 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.929127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.929712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.929989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.930259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.930923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.932419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.941476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 794/1579] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:27.942320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.951609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996da18-dead-4a50-9e4a-bb1b917a70cf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.956057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.956663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.956941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.957209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.957868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.959382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.967224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 786/1580] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:27.970278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.973920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 795/1581] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:27.974669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:27.977921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112ef94-71f0-4b6c-a02e-ac96c08b9d6f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.982665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.983542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.983816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.983995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa162-b689-4605-a6f1-c2c745d1059d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:27.984193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] PATH_INFO: `/v3/projects/275e4ca81d1248ba98718d775404a8c4/users/2bf19c9a86344181a1cadd65c2d2dcc3/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.988519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:27.989166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:27.989447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:27.989719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:27.990390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.992291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:27.998508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] RBAC: Authorizing `identity:create_grant(project_id=275e4ca81d1248ba98718d775404a8c4, user_id=2bf19c9a86344181a1cadd65c2d2dcc3, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:27.999535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:27.999535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:24:27.999535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:24:28.001479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.075828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 796/1582] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:27 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:28.076644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.085771 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea4a0-dc0c-4530-919c-3258f1897876 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.086244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 787/1583] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:27 2022] PUT /identity/v3/projects/275e4ca81d1248ba98718d775404a8c4/users/2bf19c9a86344181a1cadd65c2d2dcc3/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.087090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.140351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.140965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.141243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.141513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.142202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.144093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.144784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005a9bf-7b09-4673-abb5-27646d09caef admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.149383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.150042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.150322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.150596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.151278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.153915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.229306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 797/1584] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:28.230192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.239309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fcab0-22c9-4636-aa99-f5978fc629c9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.243686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.244300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.244607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.244879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.245600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.247663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.253028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 788/1585] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:28.254037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.257504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 798/1586] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.258298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.265813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389881-6585-4d27-9f55-dbfb09b1462d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.269969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e8892-2e45-4962-96df-a624e8ddd080 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.272578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.273226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.273500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.273774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.274488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.274616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.275156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.275438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.275711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.276191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.276437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.277970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.286044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 789/1587] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.286898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.290728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 799/1588] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.290728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.298069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b43fd-65df-4cdb-90f2-b2e1f7ba9d55 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.300184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba77b57-5d65-4bee-a8c9-33885d427f43 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.302592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.303215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.303492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.303759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.304489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.304809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.305434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.305713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.306027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.306146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeaefb-d92c-443e-82e0-8e7ca2562011 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.306720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.308256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.317824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 790/1589] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.318474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 800/1590] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.319115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.319255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.319426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.319674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.329447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8734-44c1-4694-a221-564fd102bac6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.334152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.334808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.335089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.335362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.336140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.336801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:28.337753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.337964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:28.347802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 801/1591] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.348485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.351624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 791/1592] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:28.351624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.358152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbecd8-c4cd-4142-b0ba-3a1692b3168d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.360794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e0741-c0f5-42bd-9f2c-64ee743ff0ac None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.362889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.363707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.363996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.364270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.365034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.365678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.366612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.366722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.367117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.367397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] PATH_INFO: `/v3/projects/b6b62c7e27134d3c814fb9ca90d6651f/users/6a63a5e7c4f54d6499fa4635e7885aab/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.377623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 802/1593] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.378403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.382398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b62c7e27134d3c814fb9ca90d6651f, user_id=6a63a5e7c4f54d6499fa4635e7885aab, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.385074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.389547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ea10-6c78-4a12-b91b-1901482d8287 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.394102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.394894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.395167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.395434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] PATH_INFO: `/v3/projects/8dd9cbd63beb4f96bd44c8e777fdba0a/users/d47879b0c2f7429a8bec12b89c444ae7/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.409450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd9cbd63beb4f96bd44c8e777fdba0a, user_id=d47879b0c2f7429a8bec12b89c444ae7, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.412142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.469842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 792/1594] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/b6b62c7e27134d3c814fb9ca90d6651f/users/6a63a5e7c4f54d6499fa4635e7885aab/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.470797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.481072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 803/1595] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/8dd9cbd63beb4f96bd44c8e777fdba0a/users/d47879b0c2f7429a8bec12b89c444ae7/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.485328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.529579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade33a1-068c-4f2b-9882-7dd0d9242065 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.548852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef4513-b4ea-4810-a73e-6a4144750de5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.553392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.554083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.554329 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.554601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.555310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.556963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.567211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 804/1596] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.569221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.578653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431c81-bca7-4784-8415-ef0869a8e0b0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.583195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.584050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.584324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.584526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.584662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] PATH_INFO: `/v3/projects/147af77ead57444b991a4aef5577b680/users/2d399ef4bd4e44febeeac8974f4c24e9/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.585193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.585472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.585743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.586463 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.588107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.597823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 793/1597] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.598473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.599114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147af77ead57444b991a4aef5577b680, user_id=2d399ef4bd4e44febeeac8974f4c24e9, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.602161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.608405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2679-0dcd-4b54-938c-d2f414789b30 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.612991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.613634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.613913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.614186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.617169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.617169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.626554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 794/1598] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.627329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.628915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:28.667408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 805/1599] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/147af77ead57444b991a4aef5577b680/users/2d399ef4bd4e44febeeac8974f4c24e9/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.671755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.681221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5e40-bd15-4b83-985a-39f9e914dce8 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.727205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.727850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.728132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.728432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.729140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca47f30-0faf-4edf-83b9-41d9428ec765 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.734460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.735114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.735394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.735667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.736392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.737826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.737984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793934c-6fba-487f-9adb-f098692614d4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.739245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3806810-00a8-4653-b605-a1d90f6a17f5 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.748102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 806/1600] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:28.749334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.749498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 795/1601] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:28.749738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.750025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.750707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.751200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.751319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.768535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:28.769757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:28.776229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] MFA Rules not processed for user `d47879b0c2f7429a8bec12b89c444ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:28.777429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:28.777833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 807/1602] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:28.779335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.788071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efccd9-2eb3-4a03-a884-ec7fa613ec5c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.793360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.794830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.795094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.795364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] PATH_INFO: `/v3/projects/5c47e882a00247d791d25edbdb2fce54/users/6872824c64934fbba7a3863f30f2fde0/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.810319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c47e882a00247d791d25edbdb2fce54, user_id=6872824c64934fbba7a3863f30f2fde0, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.813093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.840800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 796/1603] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:28.844255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.853109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facadcd-989f-4864-b568-ba91fcc0a92b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.858253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.859102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.859376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.859643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] PATH_INFO: `/v3/projects/2ca893e56e3d4ee1b549cec12041c952/users/8888d4dddb1f4329b0537148663b9b91/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.874414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca893e56e3d4ee1b549cec12041c952, user_id=8888d4dddb1f4329b0537148663b9b91, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.877220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da19690-72e8-42a5-b5de-9d05737efead admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.881204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 808/1604] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/5c47e882a00247d791d25edbdb2fce54/users/6872824c64934fbba7a3863f30f2fde0/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.882099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:28.940894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb79-a3f9-4664-a0dd-aa65503b901e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:28.945391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:28.946321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.946601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.946870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] PATH_INFO: `/v3/projects/bcd81a031c544c10adc637d8c1b31e23/users/624c0209795d44b29cb35925503077ab/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.959070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 797/1605] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/2ca893e56e3d4ee1b549cec12041c952/users/8888d4dddb1f4329b0537148663b9b91/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:28.960691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:28.960981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:28.961192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd81a031c544c10adc637d8c1b31e23, user_id=624c0209795d44b29cb35925503077ab, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:28.961316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:28.964043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:28.978275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:28.979475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.038419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 809/1606] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:28 2022] PUT /identity/v3/projects/bcd81a031c544c10adc637d8c1b31e23/users/624c0209795d44b29cb35925503077ab/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:29.038419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.042254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 798/1607] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.043353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.099617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe304ad-b85a-49bf-9f96-f330abf5f8fe None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.112251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d89b7-b125-4fbd-aa30-3e07248f24c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.117178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.118065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.118336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.118602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] PATH_INFO: `/v3/projects/3cef9ddfb39e443aadbda5f536a8e39d/users/225911e2ce7748a294983ef234a4d099/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.133117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef9ddfb39e443aadbda5f536a8e39d, user_id=225911e2ce7748a294983ef234a4d099, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.135743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963ca4b-427c-45ac-a3f4-fd524abb2533 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.149689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.150334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.150612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.150913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.160314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.161748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.171576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 799/1608] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.172356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.181481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54208bd-ea74-4823-b4f3-621c73787307 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.187006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.187963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.187963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.188254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.188939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.190815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086c4b2-d82a-43f1-9e70-caa107dce3dd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.206114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 810/1609] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:29 2022] PUT /identity/v3/projects/3cef9ddfb39e443aadbda5f536a8e39d/users/225911e2ce7748a294983ef234a4d099/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:29.206114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45f0-e8f2-475f-8d2b-2a5665e2bbf3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.206114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45f0-e8f2-475f-8d2b-2a5665e2bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.206114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45f0-e8f2-475f-8d2b-2a5665e2bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.227360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-943e45f0-e8f2-475f-8d2b-2a5665e2bbf3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.229183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-943e45f0-e8f2-475f-8d2b-2a5665e2bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.295481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 811/1610] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.297122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.297451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.297668 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.304061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 800/1611] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:29.305902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752fcd-6bec-4ed6-94a0-8c8c4bfb2a6c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.306188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752fcd-6bec-4ed6-94a0-8c8c4bfb2a6c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.306756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752fcd-6bec-4ed6-94a0-8c8c4bfb2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.317832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.319114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.341499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-77752fcd-6bec-4ed6-94a0-8c8c4bfb2a6c None None] MFA Rules not processed for user `624c0209795d44b29cb35925503077ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.342705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-77752fcd-6bec-4ed6-94a0-8c8c4bfb2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.382951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 812/1612] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.384089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.411302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 801/1613] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.412584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.412972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.413344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.445404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] MFA Rules not processed for user `225911e2ce7748a294983ef234a4d099`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.446645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.457216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a60e8-29b2-4948-b1c0-27cda7f5401b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.460967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.467113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.467113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.467113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.471264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.472744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.483001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 813/1614] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.484172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.494097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78971b7f-8a42-4c9c-bed5-e2e2684eaa31 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.499923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.500816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.501098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.501374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.502053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.504130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eb9c7-bfce-42e3-a29b-9cd0c0e0d29d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.515507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 802/1615] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.516963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.526233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c6e9-e0ce-45e8-a7e1-e000b703ddbd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.530448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.531094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.531375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.531646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.541483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.545294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.553661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 803/1616] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.554473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.563025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb302f-6396-42d0-9368-c718e562b2e5 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.567057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.576419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.576419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.576419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.577537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.578959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ce6a-e667-43bd-8c9d-1afc2665ac46 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.588765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 804/1617] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.589958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee0fa-f9f7-49a7-9010-f6ccb29d359f None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.590203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee0fa-f9f7-49a7-9010-f6ccb29d359f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.590507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee0fa-f9f7-49a7-9010-f6ccb29d359f None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.592098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 805/1618] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:29.593206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeeca9-3c0c-4598-94b7-6e115315b718 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.593508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeeca9-3c0c-4598-94b7-6e115315b718 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.593796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeeca9-3c0c-4598-94b7-6e115315b718 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.599659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 806/1619] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:24:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:29.605388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.605388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.605388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.606992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 814/1620] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:29.608679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.608829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.609077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.620994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.622788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.631017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:29.632301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:29.706988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 815/1621] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.716413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.729012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71edc-692b-44fe-a63e-39d18bc7cdc9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.746571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 807/1622] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:29.747855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.749342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.750035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.751030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.751740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.753494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.755266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.760757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f177084-c95c-4cf4-8dfd-dde461e1fef6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.768002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.768805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.773288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.773439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 816/1623] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:29.773543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.773632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.783233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.785300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.787983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185677-231a-44c7-85c6-e5291ad01e1e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.797023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.797741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.798370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 808/1624] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.799326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.808718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.810378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.811591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc6dd-48b2-405f-aca4-3c5969fecae2 service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:29.817916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:29.818904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:29.819528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:29.819528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] PATH_INFO: `/v3/projects/9a5879a805494869ba90183706f091c7/users/e3732226ae3649d9ab7055257d147b34/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:29.831066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.833340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.837353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5879a805494869ba90183706f091c7, user_id=e3732226ae3649d9ab7055257d147b34, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:29.839232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f85f1-3a48-42f0-a18b-7b43c010c187 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:29.845366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 817/1625] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:29.938641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 809/1626] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:29 2022] PUT /identity/v3/projects/9a5879a805494869ba90183706f091c7/users/e3732226ae3649d9ab7055257d147b34/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:29.942609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:29.955692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1a1a-f639-405a-8782-fc3141727155 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:30.094747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:30.099448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.099448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.099448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.099820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68d0a-60e7-4cc3-850c-523c221a5e55 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.099820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68d0a-60e7-4cc3-850c-523c221a5e55 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.099820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b68d0a-60e7-4cc3-850c-523c221a5e55 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.100145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:30.100238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 810/1627] 10.222.0.21 () {54 vars in 912 bytes} [Tue May 3 12:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:30.100333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:30.106533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddc87d-19b3-4fd1-9382-f27d92fc70f0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.106995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddc87d-19b3-4fd1-9382-f27d92fc70f0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.107410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddc87d-19b3-4fd1-9382-f27d92fc70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.117707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 818/1628] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:30.118721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:30.129571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c2ddc87d-19b3-4fd1-9382-f27d92fc70f0 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:30.131221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c2ddc87d-19b3-4fd1-9382-f27d92fc70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:30.153709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c245e-32f8-4b76-8f71-6b3a5b505176 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:30.162549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:30.163379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.163683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.164005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] PATH_INFO: `/v3/projects/9a5879a805494869ba90183706f091c7/users/e3732226ae3649d9ab7055257d147b34/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.166073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5879a805494869ba90183706f091c7, user_id=e3732226ae3649d9ab7055257d147b34, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:30.169110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25106b-87d4-44cd-bcfd-e2322d051d89 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:30.181784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 819/1629] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:30 2022] PUT /identity/v3/projects/9a5879a805494869ba90183706f091c7/users/e3732226ae3649d9ab7055257d147b34/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:30.191956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882a73-f447-48db-a653-5e557565213a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.196209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882a73-f447-48db-a653-5e557565213a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.196585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882a73-f447-48db-a653-5e557565213a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.198065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 820/1630] 10.222.0.21 () {54 vars in 912 bytes} [Tue May 3 12:24:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:30.200933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.201252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.201532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.228810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 811/1631] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:30.229957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.230245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.230522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.251861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:30.253166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:30.269094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] MFA Rules not processed for user `e3732226ae3649d9ab7055257d147b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:30.272248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:30.393986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 812/1632] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:30.396472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:30.432832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 821/1633] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:30.433978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:30.475589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23f329-0947-4bf1-ba66-20a531c4dddd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:30.479795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:30.480447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.480733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.481758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.493527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:30.495341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c80fbd-fd25-4736-84b6-44fa426fbf03 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:30.509036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 813/1634] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:30.518532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e5e1-6b0f-4017-9a0a-f25e21c758a9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:30.521648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:30.522368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:30.522654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:30.522928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:30.536334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:30.538286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498432db-ce31-41b0-8573-a96d0afc8de5 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:30.553489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 822/1635] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:31.449478 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:31.450723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:31.450723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:31.481869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] MFA Rules not processed for user `6a63a5e7c4f54d6499fa4635e7885aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:31.483277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:31.554206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 814/1636] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:31.566604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:31.567150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:31.567150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:31.587178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] MFA Rules not processed for user `6a63a5e7c4f54d6499fa4635e7885aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:31.588961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:31.597040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 823/1637] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:31.764836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:31.774280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c334-5c4b-496b-b933-3c298ef5129c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:31.778397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:31.779047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:31.779505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:31.779940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:31.789837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:31.791265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:31.806488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 815/1638] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:32.079665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:32.118662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70479d6a-ae0a-4fa3-9288-483721d6e057 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:32.129758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:32.130654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:32.131107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:32.131529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:32.148418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:32.154478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9695278-49cb-48e7-b06a-4ac8d70c115c service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:32.167913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 824/1639] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:32.227359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:32.236744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b8e0-c960-47d7-892c-a59d5eaa6c78 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:32.245777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:32.246754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:32.252241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:32.252241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:32.369202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:32.370651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e127ff3-d750-4812-a0af-e0cbca91888d service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:32.381053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 816/1640] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:32.801838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511861-f90d-4da1-aa86-9e12cad97ab1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:32.805987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511861-f90d-4da1-aa86-9e12cad97ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:32.810002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511861-f90d-4da1-aa86-9e12cad97ab1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:32.814468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 825/1641] 10.222.0.21 () {54 vars in 912 bytes} [Tue May 3 12:24:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:32.829047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e051ae-07e9-4225-994c-54978e46f871 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:32.829554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e051ae-07e9-4225-994c-54978e46f871 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:32.830097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e051ae-07e9-4225-994c-54978e46f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:32.920226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-82e051ae-07e9-4225-994c-54978e46f871 None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:32.927067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-82e051ae-07e9-4225-994c-54978e46f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:33.087284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 817/1642] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:33.131608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76511861-f90d-4da1-aa86-9e12cad97ab1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:33.152557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76511861-f90d-4da1-aa86-9e12cad97ab1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:33.159797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:33.160723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:33.161157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:33.161608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:33.186561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:33.187121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddaa4a-9c90-409a-bb14-ed1ab16ea267 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:33.203876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 826/1643] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:34.721653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64816a2-4b73-428b-a176-7a1494cfe531 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:34.723035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64816a2-4b73-428b-a176-7a1494cfe531 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:34.723629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64816a2-4b73-428b-a176-7a1494cfe531 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:34.725649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 818/1644] 10.222.0.21 () {54 vars in 960 bytes} [Tue May 3 12:24:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:34.731522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:34.732719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:34.733415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:34.755365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] MFA Rules not processed for user `f8536acd053b44e48493e68622d82d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:34.756884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:35.171597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64816a2-4b73-428b-a176-7a1494cfe531 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:35.181833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 827/1645] 10.222.0.21 () {58 vars in 1057 bytes} [Tue May 3 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:35.187838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64816a2-4b73-428b-a176-7a1494cfe531 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:35.187838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:35.187838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:35.187838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:35.189363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:35.189363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:35.189363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:35.189363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c7a84-73d4-4826-a46f-57bab9c595f4 service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:35.189363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 819/1646] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:38.421953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:38.594683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828aba1-275d-4f1b-b8d3-b1bf704116c9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:38.603469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:38.605068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:38.606302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:38.606969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] PATH_INFO: `/v3/users/225911e2ce7748a294983ef234a4d099` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:38.608501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225911e2ce7748a294983ef234a4d099)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:38.611079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:38.881079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225911e2ce7748a294983ef234a4d099'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:38.885359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225911e2ce7748a294983ef234a4d099'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:38.923239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225911e2ce7748a294983ef234a4d099'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:39.028471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225911e2ce7748a294983ef234a4d099'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:39.062157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225911e2ce7748a294983ef234a4d099'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:39.085648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 828/1647] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:24:38 2022] DELETE /identity/v3/users/225911e2ce7748a294983ef234a4d099 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:39.099266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:39.099730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:39.099814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:39.143175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:39.143711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:39.286914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 820/1648] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:39.307220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:39.309678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:39.439710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e8ff3-b621-40cd-bf6b-04e5e9e7a479 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:39.451698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:39.452405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:39.453093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:39.453093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:39.471677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:39.479282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1520b4-af53-46cd-91c3-d6fb1a1e8975 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:39.498297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 829/1649] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:40.822985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:40.825365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:40.843236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0804f2-110a-4e7b-820a-6e411818708c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:40.862040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:40.862923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:40.863359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:40.863929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] PATH_INFO: `/v3/projects/3cef9ddfb39e443aadbda5f536a8e39d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:40.867019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cef9ddfb39e443aadbda5f536a8e39d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:40.868989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:41.078359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cef9ddfb39e443aadbda5f536a8e39d', 'request_id': 'req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:41.092601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cef9ddfb39e443aadbda5f536a8e39d', 'request_id': 'req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:41.105201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cef9ddfb39e443aadbda5f536a8e39d', 'request_id': 'req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:41.132411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07c6c-90b6-4aa2-9ae4-c2f9d5451334 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.132894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07c6c-90b6-4aa2-9ae4-c2f9d5451334 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.132979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07c6c-90b6-4aa2-9ae4-c2f9d5451334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.198553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] The token cache is being invalidate because project 3cef9ddfb39e443aadbda5f536a8e39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:24:41.199025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:41.200040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-afe12f5d-ac91-4347-9c81-95ec4bdb6ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:41.201454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ada07c6c-90b6-4aa2-9ae4-c2f9d5451334 None None] MFA Rules not processed for user `8888d4dddb1f4329b0537148663b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:41.206986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 821/1650] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:24:40 2022] DELETE /identity/v3/projects/3cef9ddfb39e443aadbda5f536a8e39d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:41.207341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7897-75c7-4542-b2da-13971813e061 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.207772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7897-75c7-4542-b2da-13971813e061 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.208661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7897-75c7-4542-b2da-13971813e061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.209579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ada07c6c-90b6-4aa2-9ae4-c2f9d5451334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:41.253879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-07cd7897-75c7-4542-b2da-13971813e061 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:41.255856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-07cd7897-75c7-4542-b2da-13971813e061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:41.383568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 830/1651] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:41.398022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.398314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.398591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.429718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 822/1652] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:41.431125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] MFA Rules not processed for user `8888d4dddb1f4329b0537148663b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:41.431663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.432376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:41.432700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.433128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.449699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 831/1653] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:41.461103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:41.466170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:41.469939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:41.472447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:41.509788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 823/1654] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:41.515713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:41.536651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8f92c-b956-434c-8a72-e1857d51798e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:41.557872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:41.559253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.559794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.561263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.562102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:41.562705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:41.569066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:41.605562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 824/1655] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:41.610818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:41.649647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5202ea-b3ee-4043-908a-f3891aaaed2b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:41.670533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:41.671205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.673111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.674902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.676963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:41.681014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:41.707660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342618-6696-46c7-9156-7960c7c9a994 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:41.722248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:41.723362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:41.723789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:41.724206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:41.749921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:41.751553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:41.798168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 832/1656] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:41.836104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 825/1657] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:41.841533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:41.860564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac043d-9e53-4b36-85ba-d1bf769c4339 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:42.052170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:42.053329 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.053804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.054335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.061160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:42.063735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:42.172680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 833/1658] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:41 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:42.178650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:42.192130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac3f1-71ac-49a6-9257-26c959a5f529 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:42.209060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:42.210126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.211024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.212055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.224335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:42.232352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:42.282349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 826/1659] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:42.284798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:42.310422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4504-51b5-4792-9e76-70ad08cd7b82 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:42.323524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:42.324061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.327126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.327423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.328167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:42.334478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17bcdb-9337-4a84-8e2f-87cb1d35c6eb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:42.366436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 834/1660] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:42.370542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:42.385068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f5a3-b6a8-46d6-9838-70809b939fce admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:42.392985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:42.394338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.394814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.395278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] PATH_INFO: `/v3/projects/0506bae39c8a413c8a661219085cdc17/users/6854393ee601408cad7ffa4ec8565305/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.434526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0506bae39c8a413c8a661219085cdc17, user_id=6854393ee601408cad7ffa4ec8565305, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:42.438902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ba53-7793-45e1-82ab-142563acd426 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:42.531842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.532617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.534287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.559087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 827/1661] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:42 2022] PUT /identity/v3/projects/0506bae39c8a413c8a661219085cdc17/users/6854393ee601408cad7ffa4ec8565305/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:42.579018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f804-9d32-49cd-aa5f-1b2775f40954 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.579798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f804-9d32-49cd-aa5f-1b2775f40954 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.581250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f804-9d32-49cd-aa5f-1b2775f40954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.602803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:42.607682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:42.647405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-efb6f804-9d32-49cd-aa5f-1b2775f40954 None None] MFA Rules not processed for user `6854393ee601408cad7ffa4ec8565305`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:42.649126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-efb6f804-9d32-49cd-aa5f-1b2775f40954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:42.739741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 835/1662] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:42.772085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 828/1663] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:42.773435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:42.844527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:42.845093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:42.845093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:42.890256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] MFA Rules not processed for user `2bf19c9a86344181a1cadd65c2d2dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:42.895721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.083145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479177-0f4f-4b5a-8302-2d39c0a075c0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:43.100657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:43.101539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 829/1664] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:43.106285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:43.108007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:43.110816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:43.114349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:43.130971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:43.156001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:43.157651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.184209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7385-89ed-4f57-8d00-26f2b235571c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:43.198334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:43.199795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:43.200223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:43.204118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] PATH_INFO: `/v3/users/624c0209795d44b29cb35925503077ab` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:43.205808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624c0209795d44b29cb35925503077ab)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:43.207058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: WARNING py.warnings [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:43.207058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: warnings.warn(msg) May 03 12:24:43.207058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: May 03 12:24:43.212069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:43.312517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 836/1665] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:42 2022] POST /identity/v3/projects => generated 377 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:43.312517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:43.326989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.560210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810717a0-3794-4f35-975a-8f8195fc16e7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:43.603768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624c0209795d44b29cb35925503077ab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:43.605399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624c0209795d44b29cb35925503077ab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:43.627354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:43.628942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:43.629457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:43.630405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:43.639388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.703675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624c0209795d44b29cb35925503077ab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:43.721329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624c0209795d44b29cb35925503077ab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:43.748932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:43.749184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:43.762957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624c0209795d44b29cb35925503077ab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:43.766003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 837/1666] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:43.766731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:43.768172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.786006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 830/1667] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:24:43 2022] DELETE /identity/v3/users/624c0209795d44b29cb35925503077ab => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:24:43.786006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:43.793901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:43.879019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d62d3-f7cc-4b33-97f6-5d21360d36ab service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:43.993249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b85c-6994-4080-94b0-0888c0eff0a7 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:44.009089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:44.009947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.010379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.010795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.019188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:44.145686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:44.146390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.146671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.146944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.172473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:44.174680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec4268-3281-4659-aaca-7fab037842d4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:44.276429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:44.279900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9433-5c5a-4f8b-9a0f-652127cdcaef service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:44.354042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 838/1668] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:43 2022] POST /identity/v3/users => generated 295 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:44.356954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.357260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.357523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.361255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 831/1669] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:24:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:24:44.367057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c063-2ac5-4616-9ed5-3b09bf097b03 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.373140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c063-2ac5-4616-9ed5-3b09bf097b03 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.374665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c063-2ac5-4616-9ed5-3b09bf097b03 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.394107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 832/1670] 10.222.0.21 () {54 vars in 912 bytes} [Tue May 3 12:24:44 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:24:44.395458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17c063-2ac5-4616-9ed5-3b09bf097b03 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:44.433451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17c063-2ac5-4616-9ed5-3b09bf097b03 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:44.474674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:44.475515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.475870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.476215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.477069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:44.491632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:44.494322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01adc-965c-422b-8d16-051411190e10 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:44.510293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:44.541945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 833/1671] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:44.555590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.562656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.563084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.585057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 839/1672] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:44.585908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:44.638596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ec016-2362-466f-bc19-301ae0e7b8fa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:44.677333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:44.681621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:44.681851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:44.682221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] PATH_INFO: `/v3/projects/33fce05f31934a79b73128213d37f0a4/users/a34563f04b5b4f428bb7c6c1b5a6cdec/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:44.696698 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:44.706808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:44.784736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fce05f31934a79b73128213d37f0a4, user_id=a34563f04b5b4f428bb7c6c1b5a6cdec, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:44.788334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:44.952124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 840/1673] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:44 2022] PUT /identity/v3/projects/33fce05f31934a79b73128213d37f0a4/users/a34563f04b5b4f428bb7c6c1b5a6cdec/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:44.952124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:44.952124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:45.052877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 834/1674] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:45.056199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:45.098144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fce995-a85f-4a67-a7f9-6970b0a7fd2b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:45.208179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425899c-9f34-4469-88a3-7fcf23dbdcf0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:45.225084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:45.226050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.227200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.227613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.391449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:45.396273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.398090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.399554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.401023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:45.410382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34681-7d6c-4b19-b962-2af821d73cab admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:45.410531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:45.420623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:45.466229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 841/1675] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:45.470469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 835/1676] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:45.471783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:45.490000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8dcef-8875-436a-a7c3-0dbb26e2ccc4 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:45.502420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:45.503673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.504144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.505191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] PATH_INFO: `/v3/projects/33fce05f31934a79b73128213d37f0a4/users/a34563f04b5b4f428bb7c6c1b5a6cdec/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.513059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fce05f31934a79b73128213d37f0a4, user_id=a34563f04b5b4f428bb7c6c1b5a6cdec, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:45.518561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:45.542365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 842/1677] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:45 2022] PUT /identity/v3/projects/33fce05f31934a79b73128213d37f0a4/users/a34563f04b5b4f428bb7c6c1b5a6cdec/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:45.553173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170fdd-0f7f-4ace-bb53-6e99a33039a7 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.553463 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170fdd-0f7f-4ace-bb53-6e99a33039a7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.553744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170fdd-0f7f-4ace-bb53-6e99a33039a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.614019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1d170fdd-0f7f-4ace-bb53-6e99a33039a7 None None] MFA Rules not processed for user `a34563f04b5b4f428bb7c6c1b5a6cdec`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:45.615297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1d170fdd-0f7f-4ace-bb53-6e99a33039a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:45.635712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:45.638010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:45.827101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393dc24-99a9-4016-af67-419e6ac8ba35 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:45.842364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:45.843047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.843333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.843607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.845162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 836/1678] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:45.852102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73c57c-9d0e-4edf-86f0-64b7407d326f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:45.857866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73c57c-9d0e-4edf-86f0-64b7407d326f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:45.858289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73c57c-9d0e-4edf-86f0-64b7407d326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:45.873330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:45.874801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:45.895191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 843/1679] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:24:45.897392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:45.899778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:45.955663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5e73c57c-9d0e-4edf-86f0-64b7407d326f None None] MFA Rules not processed for user `2d399ef4bd4e44febeeac8974f4c24e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:45.968109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5e73c57c-9d0e-4edf-86f0-64b7407d326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:46.165039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a829-e30b-46c5-b9cc-efc27448b0e1 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:46.165039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:46.165039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:46.165039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:46.167748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:46.167748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:46.267634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 837/1680] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:46.281948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:46.283988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:46.345443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:46.345443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:46.345443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:46.348975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 844/1681] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:46.405046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] MFA Rules not processed for user `6872824c64934fbba7a3863f30f2fde0`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:46.406789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:46.439458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:46.439458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:46.647479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 838/1682] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:46.742975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad78e-074e-431e-bf19-76a846031fb1 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:46.770262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:46.770587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:46.770895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:46.771210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:46.795521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:46.806443 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:46.865778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 845/1683] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:47.260265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:47.262443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:47.283384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:47.300973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53e45-d0d8-441c-b469-da6e9636229c service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:47.353923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:47.354871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:47.355853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:47.356444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:47.407875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:47.409856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e129f-cb15-4a72-a595-edb8abc26e88 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:47.452582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 846/1684] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:24:47.522906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164379a1-89d1-44a6-90f4-bc41d6bfe9d5 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:47.547020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:47.548031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:47.548318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:47.548645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] PATH_INFO: `/v3/projects/bcd81a031c544c10adc637d8c1b31e23` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:47.550393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd81a031c544c10adc637d8c1b31e23)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:47.554688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:47.796945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd81a031c544c10adc637d8c1b31e23', 'request_id': 'req-1306d5fc-8370-4ba7-97f2-07018a950791'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:47.810363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd81a031c544c10adc637d8c1b31e23', 'request_id': 'req-1306d5fc-8370-4ba7-97f2-07018a950791'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:47.830836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd81a031c544c10adc637d8c1b31e23', 'request_id': 'req-1306d5fc-8370-4ba7-97f2-07018a950791'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:47.945362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] The token cache is being invalidate because project bcd81a031c544c10adc637d8c1b31e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:24:47.945362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:47.945362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1306d5fc-8370-4ba7-97f2-07018a950791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:47.945362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 839/1685] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:24:47 2022] DELETE /identity/v3/projects/bcd81a031c544c10adc637d8c1b31e23 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:47.949869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:47.950140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:47.950427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:48.020700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:48.022001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:48.259171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 847/1686] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:48.268395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350587-dd9d-4f6a-95a8-40616e6f412b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:48.269180 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350587-dd9d-4f6a-95a8-40616e6f412b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:48.269687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350587-dd9d-4f6a-95a8-40616e6f412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:48.312840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-90350587-dd9d-4f6a-95a8-40616e6f412b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:48.312840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-90350587-dd9d-4f6a-95a8-40616e6f412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:48.341160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 840/1687] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:48.341824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:48.371665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ff894-43b2-4aa2-86c7-0be2a6ac3dd7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:48.417242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:48.419206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:48.419629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:48.420048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:48.420974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:48.430749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:48.430749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:48.463073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:48.463686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:48.465774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:48.505999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 848/1688] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:48.507976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:48.549295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c2f28-52c9-4aa5-990d-1a9681e9621d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:48.561066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:48.563594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:48.564320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:48.564778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:48.565057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:48.565764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:48.566651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:48.567731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:48.718507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 849/1689] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:48 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:48.723627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.002424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbef1-3335-4eef-bec0-0ab4f647b2da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.051770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.058023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.062235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.066120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.080102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.096047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb99df-8a84-45e9-82fc-d25628c1dfa5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.276626 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 850/1690] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:48 2022] POST /identity/v3/users => generated 282 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:24:49.278101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.278453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.280829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.296889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 841/1691] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 3 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 836 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:49.298125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.311666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42c552-bc10-45ec-afae-a95bd562c974 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.319333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.320498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.321404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.321890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.323448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.326096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.365156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] MFA Rules not processed for user `8888d4dddb1f4329b0537148663b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:49.369530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:49.381075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 842/1692] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:49.382135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.393502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:49.491725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 851/1693] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:49.491725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.528038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812d42-08cf-460c-9488-f3180764d3e2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.537114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.537819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.538099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.538346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.539078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.541883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.568879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 852/1694] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:49.569812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.578133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:49.598850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f26b1c-61b6-4580-b93d-949a8610b727 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.617073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769391-0f29-4ded-9cd0-257f694d8a20 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.629040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.629040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.629040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.629040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.632222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.632413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.632651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.632931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] PATH_INFO: `/v3/users/d47879b0c2f7429a8bec12b89c444ae7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.635066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47879b0c2f7429a8bec12b89c444ae7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.646159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.646989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.647613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.672133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 843/1695] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:49.673032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:49.719355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6bce7-8947-4ac2-aab0-f019a548c291 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:49.743504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:49.744519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.744812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.747419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] PATH_INFO: `/v3/projects/5e9126bdeffc479185ad56eb3f231509/users/e38ee8629cd24e07ac2ae8c6df3c1783/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.823001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9126bdeffc479185ad56eb3f231509, user_id=e38ee8629cd24e07ac2ae8c6df3c1783, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:49.826579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af96eb-3f57-4ca2-a642-ddeadd9e191e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:49.957567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 844/1696] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:49 2022] PUT /identity/v3/projects/5e9126bdeffc479185ad56eb3f231509/users/e38ee8629cd24e07ac2ae8c6df3c1783/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:49.971435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:49.971972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:49.972466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:49.972589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47879b0c2f7429a8bec12b89c444ae7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:49.976795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47879b0c2f7429a8bec12b89c444ae7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:50.029320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47879b0c2f7429a8bec12b89c444ae7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:50.070774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] MFA Rules not processed for user `e38ee8629cd24e07ac2ae8c6df3c1783`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:50.073048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:50.164270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47879b0c2f7429a8bec12b89c444ae7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:50.188116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fee4845a-2866-4232-855c-8041c281a04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47879b0c2f7429a8bec12b89c444ae7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:50.205841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 853/1697] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:24:49 2022] DELETE /identity/v3/users/d47879b0c2f7429a8bec12b89c444ae7 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:50.210695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:50.211142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:50.211563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:50.266860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:50.268107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:50.269028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 845/1698] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:50.271664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:50.281971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:50.500658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 854/1699] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:50.594128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:50.602151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7092e-1119-4288-8f2e-1c8814dd8fe9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:50.602780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:50.602853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:50.602853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:50.611053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:50.612293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:50.613977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:50.633941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:50.783646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31608fb0-589c-419b-8cfd-e1adbfa73584 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:50.795585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:50.796261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:50.798169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:50.798169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:50.827420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 846/1700] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:50 2022] POST /identity/v3/projects => generated 363 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:50.831176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:50.865431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:50.866916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:50.916758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 855/1701] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:51.078031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39cbe4-5cd8-4a8b-8139-9d5cdf533d27 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:51.085701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:51.086450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.086733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.087447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.088203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:51.090922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:51.225100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 847/1702] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:50 2022] POST /identity/v3/users => generated 288 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:51.228885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:51.257977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cf54-b344-4a8b-a0d1-467a56e2128f service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:51.274619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:51.275143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.275379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.276108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.277614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:51.280455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:51.319363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 856/1703] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:51.325056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:51.344834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69ce0-dc80-4bcd-9930-394d2213e139 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:51.355740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:51.364532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.364532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.364532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] PATH_INFO: `/v3/projects/190b2292687c45bf97dafb3dca05a314/users/db2da8e28b644fe4a5c0f6b23f5b3944/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.399373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=190b2292687c45bf97dafb3dca05a314, user_id=db2da8e28b644fe4a5c0f6b23f5b3944, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:51.403315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:51.490407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 848/1704] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:51 2022] PUT /identity/v3/projects/190b2292687c45bf97dafb3dca05a314/users/db2da8e28b644fe4a5c0f6b23f5b3944/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:51.495089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:51.522458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94785c-b89f-487b-aba4-c1ad09ca4c68 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:51.640747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:51.641318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.641569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.641818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.643280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:51.645657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8880180-b640-498a-905b-8f8ef9147c13 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:51.658803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 857/1705] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:24:51.662846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:51.680732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4501e-3320-4b3b-a5dd-6e257c5a9d0d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:51.734622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:51.735595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.735873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.736232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] PATH_INFO: `/v3/projects/190b2292687c45bf97dafb3dca05a314/users/db2da8e28b644fe4a5c0f6b23f5b3944/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.741684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190b2292687c45bf97dafb3dca05a314, user_id=db2da8e28b644fe4a5c0f6b23f5b3944, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:51.748610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:51.766340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 849/1706] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:51 2022] PUT /identity/v3/projects/190b2292687c45bf97dafb3dca05a314/users/db2da8e28b644fe4a5c0f6b23f5b3944/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:51.777267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:51.777818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:51.779713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:51.904539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] MFA Rules not processed for user `db2da8e28b644fe4a5c0f6b23f5b3944`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:51.905839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:52.069099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 858/1707] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:52.076891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:52.078794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:52.160250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efb5f-a684-40c0-a161-b8a279a55c74 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:52.172007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:52.172007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:52.172007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:52.172007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:52.184047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:52.186915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:52.202485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 850/1708] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:52.542001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:52.567050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa292-bc6b-46f2-ae49-3339cc77dd75 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:52.574811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:52.575768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:52.576224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:52.577495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:52.645632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:52.653855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:52.681892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 859/1709] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:52.966821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:52.968415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:53.013576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a58dd-53e8-4934-b3e4-aa227e11bd60 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:53.061539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:53.062215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:53.062492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:53.062762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:53.077920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:53.388584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:53.390435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:53.446580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:53.449436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:53.463397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 851/1710] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:24:53.607366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dcc3-ddfb-4b35-9eef-04587fab23ff service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:53.612607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:53.613814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:53.614206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:53.614599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] PATH_INFO: `/v3/projects/8dd9cbd63beb4f96bd44c8e777fdba0a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:53.618453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd9cbd63beb4f96bd44c8e777fdba0a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:53.619618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: WARNING py.warnings [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 12:24:53.619618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: warnings.warn(msg) May 03 12:24:53.619618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: May 03 12:24:53.622136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:53.863197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd9cbd63beb4f96bd44c8e777fdba0a', 'request_id': 'req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:53.946792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd9cbd63beb4f96bd44c8e777fdba0a', 'request_id': 'req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:53.958111 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd9cbd63beb4f96bd44c8e777fdba0a', 'request_id': 'req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.000396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] The token cache is being invalidate because project 8dd9cbd63beb4f96bd44c8e777fdba0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:24:54.000691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.001376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-17280b0b-74bc-4c8c-9e1d-bb7d8affdb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.006584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 860/1711] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:24:53 2022] DELETE /identity/v3/projects/8dd9cbd63beb4f96bd44c8e777fdba0a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:54.007642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:54.032862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb1d0-3e0f-4966-b1ad-27fc7bc123d2 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:54.202194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:54.203611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:54.204167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:54.204718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] PATH_INFO: `/v3/users/e3732226ae3649d9ab7055257d147b34` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:54.206413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3732226ae3649d9ab7055257d147b34)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:54.208882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:54.336006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d703f-150c-4f0b-b477-02ca166a3235 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:54.336502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d703f-150c-4f0b-b477-02ca166a3235 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:54.336885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d703f-150c-4f0b-b477-02ca166a3235 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:54.339373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 861/1712] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 12:24:54.405211 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3732226ae3649d9ab7055257d147b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.407689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3732226ae3649d9ab7055257d147b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.444733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:54.445207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:54.445962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:54.486022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3732226ae3649d9ab7055257d147b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.496475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3732226ae3649d9ab7055257d147b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.501072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:54.506033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:54.584238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fb1b5cff-b286-4a31-aeec-441f7b1240cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3732226ae3649d9ab7055257d147b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:54.635269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 852/1713] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:24:54 2022] DELETE /identity/v3/users/e3732226ae3649d9ab7055257d147b34 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:54.686919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 862/1714] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:54.727581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:54.728126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:54.728569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:54.790865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] MFA Rules not processed for user `2d399ef4bd4e44febeeac8974f4c24e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:54.796215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:54.845843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:54.847503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:54.888294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3d49-a898-41d6-a3c3-ffad42621d95 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:55.017911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 853/1715] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:55.074138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:55.076195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:55.076789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:55.081675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:55.097472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:55.099697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac128-0c24-4dfe-9ba3-d6437eaeac86 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:55.113774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 863/1716] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:55.587001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:55.587926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:55.715888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e4ea-b0aa-4377-a886-ac329aa48020 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:55.724918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:55.725817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:55.726140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:55.726352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] PATH_INFO: `/v3/projects/9a5879a805494869ba90183706f091c7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:55.727669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5879a805494869ba90183706f091c7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:55.729854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:55.892386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198700d5-b361-45bd-a1fa-b87a48e6f967 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:55.897323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198700d5-b361-45bd-a1fa-b87a48e6f967 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:55.897846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198700d5-b361-45bd-a1fa-b87a48e6f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:55.934958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-198700d5-b361-45bd-a1fa-b87a48e6f967 None None] MFA Rules not processed for user `2bf19c9a86344181a1cadd65c2d2dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:55.936533 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-198700d5-b361-45bd-a1fa-b87a48e6f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:55.939652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5879a805494869ba90183706f091c7', 'request_id': 'req-bed7c40d-96da-471a-a3a7-8cda90c5e368'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:55.955449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5879a805494869ba90183706f091c7', 'request_id': 'req-bed7c40d-96da-471a-a3a7-8cda90c5e368'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:55.972533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5879a805494869ba90183706f091c7', 'request_id': 'req-bed7c40d-96da-471a-a3a7-8cda90c5e368'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:56.051025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] The token cache is being invalidate because project 9a5879a805494869ba90183706f091c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:24:56.051702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:56.052644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-bed7c40d-96da-471a-a3a7-8cda90c5e368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:56.055273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 854/1717] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:24:55 2022] DELETE /identity/v3/projects/9a5879a805494869ba90183706f091c7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:56.060501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.061063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.061571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.074962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 864/1718] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:56.097790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:56.099637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:56.187613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 855/1719] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:56.195446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.195738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.196688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.225183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:56.227336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:56.240748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 865/1720] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:56.243282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.256266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069618-434a-420e-9cd4-4d2541bea0dd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.262969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.263643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.263925 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.264198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.264968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:24:56.265570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.268835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.284685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 856/1721] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:24:56.289236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.303967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959cae8-bb96-4d74-b549-da2132ac84ff None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.313332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.314263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.315761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.316454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.317520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.320545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.436755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 866/1722] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:56 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:56.440481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.457209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f2863-d1ca-46a3-8c9b-d858a8ca91d5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.577362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.578112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.580699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.580699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.580699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.581674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.779653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 857/1723] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:56 2022] POST /identity/v3/users => generated 282 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:56.781206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.797621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764004-1496-48e2-937c-de8e32121360 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.812977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.813667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.813943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.814213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.814983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.816733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.841059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 867/1724] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:56.844006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.860531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573463-be8b-4fd0-be58-83f418939027 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.867820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.868589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.868871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.869143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.869874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.871505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ccd6-2b71-4c7e-8074-20c8935a0c03 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.899435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 858/1725] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:56.904054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:56.915343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5aa-f350-4752-be88-5123e54db858 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:56.923924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:56.925013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.925414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.925799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] PATH_INFO: `/v3/projects/ceb5cb7c9f4f498a93069b80c0c612e1/users/8c2458e6d47945cda03f3ed55210b177/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:56.950475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb5cb7c9f4f498a93069b80c0c612e1, user_id=8c2458e6d47945cda03f3ed55210b177, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:56.954143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21692d-ae08-4bd4-bdd5-ce630b4d6f27 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:56.975779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:56.976063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:56.976450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:57.005969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] MFA Rules not processed for user `6872824c64934fbba7a3863f30f2fde0`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:57.007403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:57.072323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 868/1726] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:56 2022] PUT /identity/v3/projects/ceb5cb7c9f4f498a93069b80c0c612e1/users/8c2458e6d47945cda03f3ed55210b177/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:57.075377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:57.076218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:57.076670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:57.081781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 859/1727] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:24:57.111267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] MFA Rules not processed for user `8c2458e6d47945cda03f3ed55210b177`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:57.113100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:57.210587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 869/1728] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:57.213550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:57.233723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4976d-e048-462c-8303-7197d5b0bc98 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:57.308576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:57.309631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:57.310054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:57.310475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:57.312223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:57.314428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:57.477681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 860/1729] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:24:57 2022] POST /identity/v3/projects => generated 363 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:24:57.482637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:57.513844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144e92-69a6-4203-a424-0ff473618f9c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:57.664116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:57.664116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:57.664116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:57.664116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:57.664843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:57.677773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:57.828411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 870/1730] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:24:57 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:24:57.829651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:57.857195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba33b-ddd5-46c8-ae9d-4b6ce3835507 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:57.873452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:57.874148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:57.876043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:57.876043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:57.877835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:57.883542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:57.921175 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 861/1731] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:57.922502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:57.944710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de83d-3215-41b9-962b-81e2c3b69045 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:57.957633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:57.958671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:57.958996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:57.959276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] PATH_INFO: `/v3/projects/631902eef663469cb544957d00011b1f/users/7927dba652ce44b2bd2990b9cabd0b3d/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.032069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] RBAC: Authorizing `identity:create_grant(project_id=631902eef663469cb544957d00011b1f, user_id=7927dba652ce44b2bd2990b9cabd0b3d, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:58.039166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:58.208773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 871/1732] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:57 2022] PUT /identity/v3/projects/631902eef663469cb544957d00011b1f/users/7927dba652ce44b2bd2990b9cabd0b3d/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:58.212711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:58.227761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62211e0b-058a-421f-870c-a4e61630cf2f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:58.330901 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:58.331819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:58.332439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:58.332919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.333893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:58.336599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:58.362227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:58.364543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 862/1733] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:24:58.378152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438d4f-31bf-4243-875b-e770850d370e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:58.387124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:58.389569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:58.405002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:58.410902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:58.411207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:58.412307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] PATH_INFO: `/v3/projects/631902eef663469cb544957d00011b1f/users/7927dba652ce44b2bd2990b9cabd0b3d/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.425769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631902eef663469cb544957d00011b1f, user_id=7927dba652ce44b2bd2990b9cabd0b3d, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:58.428481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d86c8-f85f-433b-a6fc-4f1ec6db99b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:58.430075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17116a46-2699-4a69-a319-f7a05c9d7952 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:58.451218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:58.452441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:58.459240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:58.459240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] PATH_INFO: `/v3/users/e38ee8629cd24e07ac2ae8c6df3c1783` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.459240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38ee8629cd24e07ac2ae8c6df3c1783)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:58.461976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:58.531917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 872/1734] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:24:58 2022] PUT /identity/v3/projects/631902eef663469cb544957d00011b1f/users/7927dba652ce44b2bd2990b9cabd0b3d/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:58.541828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:58.542963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:58.542963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.623636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] MFA Rules not processed for user `7927dba652ce44b2bd2990b9cabd0b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:58.623636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:58.733885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 873/1735] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:58.753720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:58.755251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:58.827845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38ee8629cd24e07ac2ae8c6df3c1783'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:58.830051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38ee8629cd24e07ac2ae8c6df3c1783'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:58.925939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77871c-a2c5-4fa5-bbe1-7c9d2f201160 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:58.947848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:58.949784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:58.950203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:58.950762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:58.952908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:58.965793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38ee8629cd24e07ac2ae8c6df3c1783'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:58.978996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:58.979203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38ee8629cd24e07ac2ae8c6df3c1783'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:58.981393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543970-72bc-4bf2-94a5-c37337454747 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:59.001524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 874/1736] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:24:59.053205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38ee8629cd24e07ac2ae8c6df3c1783'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:24:59.072519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 863/1737] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:24:58 2022] DELETE /identity/v3/users/e38ee8629cd24e07ac2ae8c6df3c1783 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:24:59.075115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:59.081396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:59.081396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:59.114323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:24:59.128747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:59.278576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 875/1738] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:24:59.324952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:24:59.331729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:24:59.518289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8fbc-5e88-43f3-b450-7d8c5818650f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:24:59.530920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:24:59.531935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:24:59.532396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:24:59.532830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:24:59.553584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:24:59.558048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:24:59.588007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 864/1739] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:00.709489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:00.711542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:00.765913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa72a7-bfa0-4c81-8726-0e94fd94b3f8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:00.777553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:00.780936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:00.781427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:00.781909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] PATH_INFO: `/v3/users/8c2458e6d47945cda03f3ed55210b177` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:00.783456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2458e6d47945cda03f3ed55210b177)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:00.788002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:00.882652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:00.887415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:00.919583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc092-4a86-4fb5-888e-e07133d86455 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:00.940564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:00.941443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:00.941722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:00.942267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] PATH_INFO: `/v3/projects/5e9126bdeffc479185ad56eb3f231509` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:00.945112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9126bdeffc479185ad56eb3f231509)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:00.947262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:01.097810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2458e6d47945cda03f3ed55210b177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.100197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2458e6d47945cda03f3ed55210b177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.116965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2458e6d47945cda03f3ed55210b177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.150923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9126bdeffc479185ad56eb3f231509', 'request_id': 'req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.161904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9126bdeffc479185ad56eb3f231509', 'request_id': 'req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.206570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9126bdeffc479185ad56eb3f231509', 'request_id': 'req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.210169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2458e6d47945cda03f3ed55210b177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.240675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-444f6c4e-7f5d-4e79-8b12-713f27e7ef9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2458e6d47945cda03f3ed55210b177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.260427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 876/1740] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:00 2022] DELETE /identity/v3/users/8c2458e6d47945cda03f3ed55210b177 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:01.265104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:01.265705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:01.266409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:01.320619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:01.322085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:01.360717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] The token cache is being invalidate because project 5e9126bdeffc479185ad56eb3f231509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:01.361444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.362254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.367331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 865/1741] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:00 2022] DELETE /identity/v3/projects/5e9126bdeffc479185ad56eb3f231509 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:01.369635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:01.371362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:01.471710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22e1c-32bf-4f17-a2f7-55fffde1c6e5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:01.569143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 877/1742] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:01.575802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:01.577513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:01.636090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:01.637152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:01.637433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:01.637707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] PATH_INFO: `/v3/users/db2da8e28b644fe4a5c0f6b23f5b3944` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:01.639055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2da8e28b644fe4a5c0f6b23f5b3944)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:01.641019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:01.723782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf147-10c2-4f69-99aa-c821de2fc26d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:01.736251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:01.744411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:01.744411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:01.744411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:01.766955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:01.772068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:01.802802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 878/1743] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:01.894662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2da8e28b644fe4a5c0f6b23f5b3944'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:01.896322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2da8e28b644fe4a5c0f6b23f5b3944'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.016520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2da8e28b644fe4a5c0f6b23f5b3944'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.024479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2da8e28b644fe4a5c0f6b23f5b3944'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.040658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d7d77f51-59c3-4165-83ab-3c8b4017fc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2da8e28b644fe4a5c0f6b23f5b3944'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.051181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 866/1744] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:01 2022] DELETE /identity/v3/users/db2da8e28b644fe4a5c0f6b23f5b3944 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:02.524625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:02.526376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:02.541080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e18ff7-2556-4acb-846b-65f4f8acad8e service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:02.623265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:02.624153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:02.624651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:02.624824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] PATH_INFO: `/v3/projects/ceb5cb7c9f4f498a93069b80c0c612e1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:02.626389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb5cb7c9f4f498a93069b80c0c612e1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:02.628777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:02.670149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa7d9-712f-4965-ab0a-10dc6446840e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:02.670444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa7d9-712f-4965-ab0a-10dc6446840e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:02.676067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa7d9-712f-4965-ab0a-10dc6446840e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:02.676067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 867/1745] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:25:02.683368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:02.683660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:02.683921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:02.703436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:02.704926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:02.798606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 868/1746] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:02.805465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb5cb7c9f4f498a93069b80c0c612e1', 'request_id': 'req-d6b4836d-8320-41d4-b7c6-777b49fe362e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.812455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:02.814081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:02.828934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ec487-6819-4bdd-a69f-2f69ad849d33 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:02.885749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb5cb7c9f4f498a93069b80c0c612e1', 'request_id': 'req-d6b4836d-8320-41d4-b7c6-777b49fe362e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.894072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb5cb7c9f4f498a93069b80c0c612e1', 'request_id': 'req-d6b4836d-8320-41d4-b7c6-777b49fe362e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.916607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] The token cache is being invalidate because project ceb5cb7c9f4f498a93069b80c0c612e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:02.917450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.918552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:02.924060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 879/1747] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:02 2022] DELETE /identity/v3/projects/ceb5cb7c9f4f498a93069b80c0c612e1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:02.925205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:02.926807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:02.931885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:02.932782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:02.933166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:02.933544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:02.935488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:02.951527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:02.955831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:02.969628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 869/1748] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:02.970703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:02.972278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:03.034849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4836d-8320-41d4-b7c6-777b49fe362e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.040007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.041055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.041493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.043645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] PATH_INFO: `/v3/projects/190b2292687c45bf97dafb3dca05a314` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.045004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=190b2292687c45bf97dafb3dca05a314)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.047373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.054560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a74a-5c6c-49ec-b0ef-e5a5ffdf1263 service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.059494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.060482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.060828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.061172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] PATH_INFO: `/v3/users/7927dba652ce44b2bd2990b9cabd0b3d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.063002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7927dba652ce44b2bd2990b9cabd0b3d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.065779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.163580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190b2292687c45bf97dafb3dca05a314', 'request_id': 'req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.230372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190b2292687c45bf97dafb3dca05a314', 'request_id': 'req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.236815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190b2292687c45bf97dafb3dca05a314', 'request_id': 'req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.248811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] The token cache is being invalidate because project 190b2292687c45bf97dafb3dca05a314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:03.249097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.249816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c48b8e37-1dc1-4ddb-a1ac-0fc963d0f96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.251402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 880/1749] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:02 2022] DELETE /identity/v3/projects/190b2292687c45bf97dafb3dca05a314 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:03.255882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d06d-8c1d-4f7c-9ebf-f5248a9f5a02 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.256248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d06d-8c1d-4f7c-9ebf-f5248a9f5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.256618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d06d-8c1d-4f7c-9ebf-f5248a9f5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.274499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fcf4d06d-8c1d-4f7c-9ebf-f5248a9f5a02 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:03.275695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fcf4d06d-8c1d-4f7c-9ebf-f5248a9f5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:03.276108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7927dba652ce44b2bd2990b9cabd0b3d'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.277330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7927dba652ce44b2bd2990b9cabd0b3d'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.333063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 881/1750] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:03.342510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7927dba652ce44b2bd2990b9cabd0b3d'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.342747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.343036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.343310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.350987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7927dba652ce44b2bd2990b9cabd0b3d'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.361090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:03.362281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:03.362464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7927dba652ce44b2bd2990b9cabd0b3d'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:03.368313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 870/1751] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:02 2022] DELETE /identity/v3/users/7927dba652ce44b2bd2990b9cabd0b3d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:03.370255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 882/1752] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:03.374124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.435221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965fc24-d504-40f0-beae-12342afd9378 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.439873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.440576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.440864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.441138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.441876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:03.442173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.443854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.460576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 871/1753] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:03.461988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.471128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7779df-7a16-42b2-b583-358ce293f644 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.475951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.476633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.476916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.477189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.477879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.479856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.595398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 883/1754] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:03 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:03.597820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.610040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ffa16-9abe-4850-8717-5087b54e5563 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.679469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.680143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.680455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.680729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.681429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.683889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.806173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 872/1755] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:03 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:03.811075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.821308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88eb5f-5802-4746-8c20-f1af74c54c10 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.827978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.827978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.827978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.827978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.828390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.829458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.839520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 884/1756] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:03.843288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.846938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.851027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:03.853933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e891-ee60-4c24-9a76-f43bd75e19e4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.862310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53f1b-d5ad-4d7f-82b7-08c819b98833 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.867181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.868046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.868327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.868667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] PATH_INFO: `/v3/projects/631902eef663469cb544957d00011b1f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.869197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.869828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=631902eef663469cb544957d00011b1f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.869926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.871408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.871681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.872316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.872459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.874053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:03.885587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 873/1757] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:03.889781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:03.901439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ae7b-3b9a-4897-abc4-44040eddaadd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:03.906301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:03.907179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:03.908377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:03.908377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] PATH_INFO: `/v3/projects/de3f2eac274547b58f441c72ee614d5b/users/24e135bcb9134a04b76231b240a26fd5/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:03.923274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3f2eac274547b58f441c72ee614d5b, user_id=24e135bcb9134a04b76231b240a26fd5, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:03.925961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20478228-00b2-45fa-8446-f388c8efdbb0 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.022239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 874/1758] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:03 2022] PUT /identity/v3/projects/de3f2eac274547b58f441c72ee614d5b/users/24e135bcb9134a04b76231b240a26fd5/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:04.029346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631902eef663469cb544957d00011b1f', 'request_id': 'req-af90f2cd-af35-454b-9d5b-a445a4413daa'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:04.033553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.033841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.034116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.060146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] MFA Rules not processed for user `24e135bcb9134a04b76231b240a26fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:04.061301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:04.091011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631902eef663469cb544957d00011b1f', 'request_id': 'req-af90f2cd-af35-454b-9d5b-a445a4413daa'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:04.096907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631902eef663469cb544957d00011b1f', 'request_id': 'req-af90f2cd-af35-454b-9d5b-a445a4413daa'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:04.117225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] The token cache is being invalidate because project 631902eef663469cb544957d00011b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:04.117689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:04.118360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af90f2cd-af35-454b-9d5b-a445a4413daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:04.120746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 885/1759] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:03 2022] DELETE /identity/v3/projects/631902eef663469cb544957d00011b1f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:04.126452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d220-17e9-496b-be78-ba611bc0215f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.126735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d220-17e9-496b-be78-ba611bc0215f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.127021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d220-17e9-496b-be78-ba611bc0215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.140060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 875/1760] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:04.141644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.143239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:04.146505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7453d220-17e9-496b-be78-ba611bc0215f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:04.147691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7453d220-17e9-496b-be78-ba611bc0215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:04.207945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 886/1761] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:04.211532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c058-7778-4c41-8aea-39880c1f1653 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.216150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.216480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.216763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.216992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.217647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.217924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.218198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.218879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.220810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.236802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:04.238015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:04.246794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 887/1762] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:04.256762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.268642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c67d1-da30-4534-b92d-ef03c7b06910 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.277536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.280245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.280245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.280245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.280245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:04.280245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.281630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.294473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 888/1763] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:04.298778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.309456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ca836-6765-4fc8-8c0a-6f74fdbfc56e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.311455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 876/1764] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:04.315387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.383368 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.384038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.384311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.384617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.385300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.387275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.400170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850a33-5085-489e-9b76-a6e26d39aa62 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.406846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.407554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.407831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.408128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.408950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.410896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.492596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 889/1765] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:04.496599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.502725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 877/1766] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:04.506311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.515743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca363-f8c3-4f64-8c6e-4d56620a49d5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.559167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd96db-3e27-450c-b42f-a79cb1db1ff1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.564044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.564882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.565269 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.565617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.566309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.568267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.571045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.571790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.572162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.572532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.573888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.575563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.585416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 878/1767] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:04.590212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.599410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd95e7-740e-4d58-97f0-b7b1c9bec863 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.603955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.604828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.605139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.605412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] PATH_INFO: `/v3/projects/413ba5a7762b48918e7b980279e9ccce/users/e3d8cf8a3094453eaf3d6f589b94bfea/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.619072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413ba5a7762b48918e7b980279e9ccce, user_id=e3d8cf8a3094453eaf3d6f589b94bfea, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.621733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.720291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 890/1768] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:04.724238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.726342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 879/1769] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:04 2022] PUT /identity/v3/projects/413ba5a7762b48918e7b980279e9ccce/users/e3d8cf8a3094453eaf3d6f589b94bfea/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:04.729943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.734911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018895-ae34-47fb-afa4-a9aec1d65e77 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.803466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.804149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.804466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.804747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.805481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.807123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.814976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193924e-c683-4bd4-9f9a-1c326cd110f4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.818747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 891/1770] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:04.822437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.831140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.839107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.839107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.839299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6add-d076-43e5-9280-b3b905a0c554 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.839381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.839381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.839381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.841165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.841852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.842136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.842412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.843134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.844785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.850322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 880/1771] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:04.851498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.863607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 892/1772] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:04.868221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:04.869294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f0e3-00e1-4068-9cfd-21d8f4e9fef6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.875084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.875632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020138db-df7d-4dbd-8ff9-cb649cb15b76 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:04.876000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.876279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.876633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] PATH_INFO: `/v3/projects/413ba5a7762b48918e7b980279e9ccce/users/e3d8cf8a3094453eaf3d6f589b94bfea/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.878992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413ba5a7762b48918e7b980279e9ccce, user_id=e3d8cf8a3094453eaf3d6f589b94bfea, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.881727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62186b05-c2f3-473d-a470-2c0be9dd62d5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.892474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:04.893399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.893681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.893957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] PATH_INFO: `/v3/projects/4fe6a151640d4f9c8617a018d6424362/users/3d62c934e2a24102b6ae032a06c6559b/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.898607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 881/1773] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:04 2022] PUT /identity/v3/projects/413ba5a7762b48918e7b980279e9ccce/users/e3d8cf8a3094453eaf3d6f589b94bfea/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:04.909991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:04.910615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:04.911075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe6a151640d4f9c8617a018d6424362, user_id=3d62c934e2a24102b6ae032a06c6559b, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:04.911184 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:04.914083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adb859-2508-4a0f-bb09-afdb3745ef40 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:04.952010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] MFA Rules not processed for user `e3d8cf8a3094453eaf3d6f589b94bfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:04.953367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:05.044414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 882/1774] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:05.055534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:05.057234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:05.137900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f50a-e41f-4ee3-a29a-3a30b461343a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:05.144059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:05.144841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:05.145121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:05.145420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:05.157840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:05.159369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:05.172410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 883/1775] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:05.226620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:05.231731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:05.240634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7858d6-49cb-4a77-881d-2ec69505d565 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:05.244638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:05.245318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:05.245647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:05.245867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:05.294581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 893/1776] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:04 2022] PUT /identity/v3/projects/4fe6a151640d4f9c8617a018d6424362/users/3d62c934e2a24102b6ae032a06c6559b/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:05.297475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:05.297948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:05.298421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:05.351518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] MFA Rules not processed for user `3d62c934e2a24102b6ae032a06c6559b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:05.352749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:05.376469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:05.377987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:05.397092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 884/1777] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:05.493981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 894/1778] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:05.498681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:05.629226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056c93-eab6-49f7-9b8d-bdb7acde13e0 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:05.722874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:05.723666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:05.724147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:05.724526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:05.725337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:05.727511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:05.833350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 885/1779] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:05 2022] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:05.837697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:05.850366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942365-5e1b-43a5-87a3-c59ed79e1ea2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:05.910234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:05.910993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:05.911346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:05.911692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:05.912430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:05.914749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.000283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 895/1780] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:05 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:06.004444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:06.017745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524e2f-8d38-46eb-8754-89fe9d5fb42a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:06.031366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:06.031366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.031366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.031366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.031722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:06.031722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.039802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 886/1781] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:06.044845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:06.054809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c245e2-8561-4676-88b2-279a2a819fc7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:06.060190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:06.061109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.061390 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.061671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] PATH_INFO: `/v3/projects/4af143f27d57490da33132f49a06723b/users/f272203f052e400db0bb765d419e101f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.076261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af143f27d57490da33132f49a06723b, user_id=f272203f052e400db0bb765d419e101f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:06.079027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.206383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 896/1782] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:06 2022] PUT /identity/v3/projects/4af143f27d57490da33132f49a06723b/users/f272203f052e400db0bb765d419e101f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:06.210311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:06.224268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8662-4e63-4956-9e77-d9fbbc78faf0 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:06.339710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:06.342454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.343047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.343454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.344497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:06.347111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e80d-24cf-40e3-b28b-0edd8a7161fe admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.361188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 887/1783] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:06.365853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:06.382998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1d2ef-2f90-40a9-be70-392793b2ee82 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:06.389529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:06.391528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.392043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.392664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] PATH_INFO: `/v3/projects/4af143f27d57490da33132f49a06723b/users/f272203f052e400db0bb765d419e101f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.396047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af143f27d57490da33132f49a06723b, user_id=f272203f052e400db0bb765d419e101f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:06.398894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.435422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 897/1784] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:06 2022] PUT /identity/v3/projects/4af143f27d57490da33132f49a06723b/users/f272203f052e400db0bb765d419e101f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:06.445522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.450149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.450149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.488847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] MFA Rules not processed for user `f272203f052e400db0bb765d419e101f`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:06.490187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:06.580087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 888/1785] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:06.593077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:06.654217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fef1e2-9b91-491a-8a4d-83e7d9822a3d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:06.659120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:06.659468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:06.659913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:06.660206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:06.677326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:06.678991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:06.688847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 898/1786] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:06.985910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:07.005090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96669206-ec4f-47e0-ab97-df0fef3922c9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:07.009470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:07.010085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:07.010900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:07.011360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:07.071663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:07.073697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82523db-abac-4722-977d-9126de24e11e service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:07.085664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 889/1787] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:13.035778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:13.136659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e251f-1184-4ef9-b8e9-b3c24c21d23a service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:13.142367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:13.143259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:13.143538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:13.143808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] PATH_INFO: `/v3/users/24e135bcb9134a04b76231b240a26fd5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:13.145035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e135bcb9134a04b76231b240a26fd5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:13.146965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:13.359695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e135bcb9134a04b76231b240a26fd5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:13.360398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e135bcb9134a04b76231b240a26fd5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:13.368091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e135bcb9134a04b76231b240a26fd5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:13.484385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e135bcb9134a04b76231b240a26fd5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:13.498935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e135bcb9134a04b76231b240a26fd5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:13.506259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 899/1788] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:13 2022] DELETE /identity/v3/users/24e135bcb9134a04b76231b240a26fd5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:13.511068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4843-2413-4a5c-890f-462b77ed9bc9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:13.513610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4843-2413-4a5c-890f-462b77ed9bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:13.514118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4843-2413-4a5c-890f-462b77ed9bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:13.533400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-495b4843-2413-4a5c-890f-462b77ed9bc9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:13.534917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-495b4843-2413-4a5c-890f-462b77ed9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:13.608130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 890/1789] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:13.635595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:13.638274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:13.770476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624bce3-9680-4a5d-888f-65c85436abc1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:13.777119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:13.777781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:13.778062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:13.778331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:13.790977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:13.793298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ae1d-ab37-44cd-92b6-53d10e674b55 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:13.817913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 900/1790] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:14.329244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:14.329244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:14.329244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:14.336700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 891/1791] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:25:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:25:14.347639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:14.348679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:14.349221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:14.375060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:14.375060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:14.461895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 901/1792] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:14.479141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:14.481391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:14.502566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b2e83-df03-4668-8ead-c84569bc6d4e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:14.510399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:14.511558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:14.513469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:14.513469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] PATH_INFO: `/v3/projects/de3f2eac274547b58f441c72ee614d5b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:14.514433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3f2eac274547b58f441c72ee614d5b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:14.516335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:14.563245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:14.563245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:14.576549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689bfa-b5b2-4228-a628-27e035ce0261 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:14.583272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:14.584553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:14.584766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:14.585043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:14.597442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:14.599097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:14.612513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 902/1793] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:14.629976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3f2eac274547b58f441c72ee614d5b', 'request_id': 'req-ac941c85-9bc9-455a-889b-10c1cd42f006'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.638176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3f2eac274547b58f441c72ee614d5b', 'request_id': 'req-ac941c85-9bc9-455a-889b-10c1cd42f006'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.643891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3f2eac274547b58f441c72ee614d5b', 'request_id': 'req-ac941c85-9bc9-455a-889b-10c1cd42f006'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.739334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] The token cache is being invalidate because project de3f2eac274547b58f441c72ee614d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:14.739622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.740261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.742252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 892/1794] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:14 2022] DELETE /identity/v3/projects/de3f2eac274547b58f441c72ee614d5b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:14.746497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:14.757006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8479-d654-4727-8652-7e253017abe0 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:14.811724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:14.812621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:14.812900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:14.813168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] PATH_INFO: `/v3/users/e3d8cf8a3094453eaf3d6f589b94bfea` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:14.814347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d8cf8a3094453eaf3d6f589b94bfea)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:14.816242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:14.983277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d8cf8a3094453eaf3d6f589b94bfea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.984057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d8cf8a3094453eaf3d6f589b94bfea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:14.991484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d8cf8a3094453eaf3d6f589b94bfea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.063357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d8cf8a3094453eaf3d6f589b94bfea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.078144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5816f22-6cff-4226-ac04-88dc73411be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d8cf8a3094453eaf3d6f589b94bfea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.090095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 903/1795] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:14 2022] DELETE /identity/v3/users/e3d8cf8a3094453eaf3d6f589b94bfea => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:15.605191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:15.607118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:15.624975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac941c85-9bc9-455a-889b-10c1cd42f006 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:15.689269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:15.690208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:15.690502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:15.690754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] PATH_INFO: `/v3/projects/413ba5a7762b48918e7b980279e9ccce` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:15.696017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413ba5a7762b48918e7b980279e9ccce)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:15.696017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:15.810451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413ba5a7762b48918e7b980279e9ccce', 'request_id': 'req-91418bbc-be6a-4549-8a70-6fef1e4579c9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.816756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413ba5a7762b48918e7b980279e9ccce', 'request_id': 'req-91418bbc-be6a-4549-8a70-6fef1e4579c9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.822224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413ba5a7762b48918e7b980279e9ccce', 'request_id': 'req-91418bbc-be6a-4549-8a70-6fef1e4579c9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.888532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] The token cache is being invalidate because project 413ba5a7762b48918e7b980279e9ccce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:15.888825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.889496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91418bbc-be6a-4549-8a70-6fef1e4579c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:15.891142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 893/1796] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:15 2022] DELETE /identity/v3/projects/413ba5a7762b48918e7b980279e9ccce => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:15.896026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:15.896513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:15.899243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:15.914515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:15.915730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:15.972294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 904/1797] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:15.979715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:15.980003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:15.980278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:15.997866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:15.999076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:16.007193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 894/1798] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:16.011379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.021253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a53b9-2d36-449e-b61c-d52e91d6a464 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.026467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.027116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.027398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.027700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.028448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:16.028755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.030339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.041461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 905/1799] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:16.045828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.054785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9033-f096-4d17-994c-9db1b4ae274e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.059355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.059997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.060281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.060584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.061268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.063136 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.156525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 895/1800] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:16 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:16.157725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.167572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b970e-a687-4b6e-950e-0f079c04e766 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.226027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.226987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.227584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.228009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.228921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.231040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.321442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 906/1801] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:16 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:16.330340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.341366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395ca3-7c79-4d5c-afef-c60e311f9183 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.346450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.347231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.347580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.347922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.348701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.350385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.362661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 896/1802] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:16.366729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.377175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892cae-7c76-4244-8685-c841994a2708 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.381757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.382413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.382694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.382970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.383685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.386105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a1fa-4d2a-4548-a0a9-c0dceedbe167 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.396605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 907/1803] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:16.400958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.411460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5333e17-684c-4699-b89d-4e3964d6c50c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.416048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.416952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.417234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.417502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] PATH_INFO: `/v3/projects/203ce8c21db140c6ae610959dd70576e/users/75e4ad0cef6b4e4e87a7233d608035f1/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.432468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203ce8c21db140c6ae610959dd70576e, user_id=75e4ad0cef6b4e4e87a7233d608035f1, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.435103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.500450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 897/1804] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:16 2022] PUT /identity/v3/projects/203ce8c21db140c6ae610959dd70576e/users/75e4ad0cef6b4e4e87a7233d608035f1/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:16.511445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37982d4f-3a99-4991-944c-6405001d741b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.511781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37982d4f-3a99-4991-944c-6405001d741b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.512057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37982d4f-3a99-4991-944c-6405001d741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.536947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-37982d4f-3a99-4991-944c-6405001d741b None None] MFA Rules not processed for user `75e4ad0cef6b4e4e87a7233d608035f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:16.538138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-37982d4f-3a99-4991-944c-6405001d741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:16.599482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 908/1805] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:16.604604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.663877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ec6e-ac72-4460-8633-8bfdc9b715e5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.669279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.669933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.670207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.670484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.671164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.673082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:16.793697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 898/1806] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:16 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:16.798956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37982d4f-3a99-4991-944c-6405001d741b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:16.811097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37982d4f-3a99-4991-944c-6405001d741b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:16.873526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:16.874300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:16.874681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:16.875021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:16.875773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:16.877822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.001354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 909/1807] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:16 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:17.002378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.018406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f44af-461a-4c75-90b5-b2b6470a9197 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.030033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.030822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.031004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.031274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.032004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.037783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.050283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 899/1808] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:17.054044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.068171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed1263-76f4-4afd-a706-fbca9a6daf3d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.079260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.080167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.080478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.080749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] PATH_INFO: `/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc/users/4ce72157f4324b5e8eb855b2845f86bc/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.107081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8aa42c930d4b4abf69c12e8f1128bc, user_id=4ce72157f4324b5e8eb855b2845f86bc, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.115134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.233546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 910/1809] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:17 2022] PUT /identity/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc/users/4ce72157f4324b5e8eb855b2845f86bc/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:17.237508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.247720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdff134-b4e1-4599-ac3c-f3be41293f10 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.375472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.376292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.376624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.376897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.377738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.379347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cabc1c-4833-4f64-a1bb-b318cf132bb9 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.394504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 900/1810] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:17.405610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.415356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c5d2-ff8e-457c-8946-605b943df2f7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.426167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.427398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.431419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.431419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] PATH_INFO: `/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc/users/4ce72157f4324b5e8eb855b2845f86bc/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.431419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8aa42c930d4b4abf69c12e8f1128bc, user_id=4ce72157f4324b5e8eb855b2845f86bc, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.433091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.446582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 911/1811] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:17 2022] PUT /identity/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc/users/4ce72157f4324b5e8eb855b2845f86bc/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:17.460237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.460237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.460237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.492938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] MFA Rules not processed for user `4ce72157f4324b5e8eb855b2845f86bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:17.496277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:17.589123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 901/1812] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:17.601282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.603652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:17.674307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161a978-f4d0-44b9-a62b-7af2870440f4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.678760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.679578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.679929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.680270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.694178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.696391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:17.731051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 912/1813] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:17.839502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:17.849960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899fb20-65d5-4150-988a-fe491d9b7233 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:17.854347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:17.854996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:17.855440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:17.855869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:17.976961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:17.989695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0527f-e37b-46bf-a34d-0668e638d149 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:18.001738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 902/1814] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:18.555607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:18.557087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:18.645076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe5730-79fc-4afe-8c2f-1092eb1ed2d0 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:18.652118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:18.653300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:18.653642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:18.653991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] PATH_INFO: `/v3/users/3d62c934e2a24102b6ae032a06c6559b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:18.655744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d62c934e2a24102b6ae032a06c6559b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:18.657764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:18.934100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d62c934e2a24102b6ae032a06c6559b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:18.934885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d62c934e2a24102b6ae032a06c6559b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:18.941918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d62c934e2a24102b6ae032a06c6559b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:19.026321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d62c934e2a24102b6ae032a06c6559b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:19.039083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d62c934e2a24102b6ae032a06c6559b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:19.045721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 913/1815] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:18 2022] DELETE /identity/v3/users/3d62c934e2a24102b6ae032a06c6559b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:19.050101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:19.050757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:19.050757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:19.067363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:19.068740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:19.131074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 903/1816] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:19.141483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:19.143153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:19.199940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc359-c83b-4a69-a39d-80fd19fdbba9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:19.203670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:19.204316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:19.204625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:19.204892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:19.213936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:19.215358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:19.225210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 914/1817] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:19.858411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:19.860049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:19.883011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b980e2-98f9-4215-8aa0-fcd5e7152ad2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:19.890338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:19.891212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:19.891767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:19.892269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] PATH_INFO: `/v3/projects/4fe6a151640d4f9c8617a018d6424362` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:19.894087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe6a151640d4f9c8617a018d6424362)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:19.896676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:20.040645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe6a151640d4f9c8617a018d6424362', 'request_id': 'req-a9437bed-4ce6-470f-9152-3d0428dc29f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.048058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe6a151640d4f9c8617a018d6424362', 'request_id': 'req-a9437bed-4ce6-470f-9152-3d0428dc29f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.054081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe6a151640d4f9c8617a018d6424362', 'request_id': 'req-a9437bed-4ce6-470f-9152-3d0428dc29f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.113906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] The token cache is being invalidate because project 4fe6a151640d4f9c8617a018d6424362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:20.114196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.115046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.120325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 904/1818] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:19 2022] DELETE /identity/v3/projects/4fe6a151640d4f9c8617a018d6424362 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:20.121523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:20.145860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9cdf-38a5-498c-9c80-27050fbb73c7 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:20.238584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:20.239521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:20.239802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:20.240073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] PATH_INFO: `/v3/users/f272203f052e400db0bb765d419e101f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:20.241305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f272203f052e400db0bb765d419e101f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:20.243514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:20.477704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f272203f052e400db0bb765d419e101f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.478612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f272203f052e400db0bb765d419e101f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.486911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f272203f052e400db0bb765d419e101f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.581994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f272203f052e400db0bb765d419e101f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.599532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f272203f052e400db0bb765d419e101f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:20.606374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 915/1819] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:20 2022] DELETE /identity/v3/users/f272203f052e400db0bb765d419e101f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:21.184505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:21.186228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:21.210109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437bed-4ce6-470f-9152-3d0428dc29f6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:21.229208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:21.231370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:21.314270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:21.315152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.315428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.315761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] PATH_INFO: `/v3/projects/4af143f27d57490da33132f49a06723b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.317062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af143f27d57490da33132f49a06723b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:21.320742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:21.382362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06450-bf6b-4d02-8689-ec66d3d697f3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:21.387083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:21.387963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.388306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.388617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] PATH_INFO: `/v3/users/75e4ad0cef6b4e4e87a7233d608035f1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.389846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e4ad0cef6b4e4e87a7233d608035f1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:21.391786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:21.450880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af143f27d57490da33132f49a06723b', 'request_id': 'req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.457947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af143f27d57490da33132f49a06723b', 'request_id': 'req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.465141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af143f27d57490da33132f49a06723b', 'request_id': 'req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.548149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] The token cache is being invalidate because project 4af143f27d57490da33132f49a06723b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:21.548992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.549872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1850505b-7e2d-45da-a2bd-8edb2cd5c2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.555343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 905/1820] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:21 2022] DELETE /identity/v3/projects/4af143f27d57490da33132f49a06723b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:21.556999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31720a-e9f2-45a6-8780-d9d63d5a17ac None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.557763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31720a-e9f2-45a6-8780-d9d63d5a17ac None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.558041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31720a-e9f2-45a6-8780-d9d63d5a17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.602440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7f31720a-e9f2-45a6-8780-d9d63d5a17ac None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:21.604299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7f31720a-e9f2-45a6-8780-d9d63d5a17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:21.626490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e4ad0cef6b4e4e87a7233d608035f1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.627948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e4ad0cef6b4e4e87a7233d608035f1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.645744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e4ad0cef6b4e4e87a7233d608035f1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.693414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 906/1821] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:21.701854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.702125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.702358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.722454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:21.723585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:21.732409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 907/1822] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:21.736716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:21.740237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e4ad0cef6b4e4e87a7233d608035f1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.747538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013efbd-f401-4ed9-bf8a-f40d743016df None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:21.752614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:21.753530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.753731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.754081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.754874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:21.755331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:21.757012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:21.762322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7b1df59d-f7fb-430d-832d-ef8cca10c466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e4ad0cef6b4e4e87a7233d608035f1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:21.772442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 916/1823] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:21 2022] DELETE /identity/v3/users/75e4ad0cef6b4e4e87a7233d608035f1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:21.776969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 908/1824] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:21.778099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:21.781500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.781500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.781500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.797345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e1d65-f5ab-48b7-986a-77753af0721d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:21.818572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:21.822742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:21.907625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:21.909820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:21.910106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:21.910381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:21.911530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:21.914249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:21.925227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 917/1825] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:21.936893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:21.940404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:22.000930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bf626-4813-40e1-ab1e-88f51b01fedb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.004709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.005360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.005638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.005909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.015141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.016587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.026163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 918/1826] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:22.030033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 909/1827] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:21 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:22.034574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.044660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc0b6-8a63-49bb-98e2-46d3bf86e83b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.106217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.106892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.107211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.107519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.108142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.110112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.272127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 919/1828] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:22 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:22.274809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.288894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85870-bf11-4887-b18a-f53522880b18 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.298372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.299031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.299860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.300244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.301068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.303037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.318744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 910/1829] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:22.320189 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.336683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c021-ff37-4b49-8f64-3dc3208b23c0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.343327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.344101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.344654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.344928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.345676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.350803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3ba25-da4f-4fc3-9517-41e4815c9b30 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.365796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 920/1830] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:22.368385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.395430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e2b-3494-4625-914b-3e45f6013f1a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.407643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.413700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.413987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.419856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] PATH_INFO: `/v3/projects/cfe2e36d262b4aebb7c5e6e0839cfae7/users/5d740a97f5994a39b5e1f23f8b81a095/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.441935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe2e36d262b4aebb7c5e6e0839cfae7, user_id=5d740a97f5994a39b5e1f23f8b81a095, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.445445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.559870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 911/1831] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:22 2022] PUT /identity/v3/projects/cfe2e36d262b4aebb7c5e6e0839cfae7/users/5d740a97f5994a39b5e1f23f8b81a095/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:22.571394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.572599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.573146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.618701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] MFA Rules not processed for user `5d740a97f5994a39b5e1f23f8b81a095`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:22.620172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:22.670820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.672586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:22.770614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 921/1832] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:22.775751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:22.800517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc7fb1-4585-4210-8d91-84425eaac658 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.810886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.811958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.812746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.812746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] PATH_INFO: `/v3/projects/203ce8c21db140c6ae610959dd70576e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.814784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203ce8c21db140c6ae610959dd70576e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.816245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.908195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926521-3f7a-4665-9574-4dfc3d35219f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:22.914643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:22.915526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:22.918319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:22.918319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:22.918319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:22.919291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:22.966332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203ce8c21db140c6ae610959dd70576e', 'request_id': 'req-fcdcea56-64aa-43c3-8b1d-059d6dad1046'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:22.975093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203ce8c21db140c6ae610959dd70576e', 'request_id': 'req-fcdcea56-64aa-43c3-8b1d-059d6dad1046'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:22.981200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203ce8c21db140c6ae610959dd70576e', 'request_id': 'req-fcdcea56-64aa-43c3-8b1d-059d6dad1046'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.019656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 922/1833] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:22 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:23.019656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.019656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.046447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] The token cache is being invalidate because project 203ce8c21db140c6ae610959dd70576e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:23.046743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.047431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.049677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 912/1834] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:22 2022] DELETE /identity/v3/projects/203ce8c21db140c6ae610959dd70576e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:23.050519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.051903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.089475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfac93-6f9a-4fe8-b7ea-8713d781b09d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.094961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.099836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.099836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.099836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] PATH_INFO: `/v3/users/6854393ee601408cad7ffa4ec8565305` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.099836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6854393ee601408cad7ffa4ec8565305)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.101770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.143051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcea56-64aa-43c3-8b1d-059d6dad1046 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.148110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.148815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.149127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.149398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.150144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.152190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.254392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 913/1835] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:23 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:23.254392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.265225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.283742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85929-b9e3-4282-9455-f53562623d95 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.286656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.287600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.287878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.288202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] PATH_INFO: `/v3/users/4ce72157f4324b5e8eb855b2845f86bc` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.289566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce72157f4324b5e8eb855b2845f86bc)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.292076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.355613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6854393ee601408cad7ffa4ec8565305'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.357061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6854393ee601408cad7ffa4ec8565305'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.370280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6854393ee601408cad7ffa4ec8565305'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.456014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6854393ee601408cad7ffa4ec8565305'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.468867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6854393ee601408cad7ffa4ec8565305'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.474848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 923/1836] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:23 2022] DELETE /identity/v3/users/6854393ee601408cad7ffa4ec8565305 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:23.477809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.477809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.546624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc978b5-70bd-477f-b294-1a72e17783bc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.551468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.552224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.552674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.552956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.554039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.555712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b86b06-2712-40c4-9ef2-df4e63c6ac73 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.559880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce72157f4324b5e8eb855b2845f86bc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.562362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce72157f4324b5e8eb855b2845f86bc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.568761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 924/1837] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:23.568761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.568981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.570811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.587089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:23.588383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.596292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 925/1838] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:23.596991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.598455 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.610818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c411b-59a3-4875-a6de-e2a6d352ff96 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.616229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.617131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.617412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.617684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] PATH_INFO: `/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e/users/e832219a7736469e820baf72ee52bce5/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.631558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce72157f4324b5e8eb855b2845f86bc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.632698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fd8e64782d4c01a1e95b3e8f57668e, user_id=e832219a7736469e820baf72ee52bce5, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.635130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.639985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce72157f4324b5e8eb855b2845f86bc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.652625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce72157f4324b5e8eb855b2845f86bc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:23.658897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 914/1839] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:23 2022] DELETE /identity/v3/users/4ce72157f4324b5e8eb855b2845f86bc => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:23.659473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.662617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:23.724153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 926/1840] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:23 2022] PUT /identity/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e/users/e832219a7736469e820baf72ee52bce5/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:23.728209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.745356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7ce7-3769-494a-b0ed-3980ea2761ca admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.815702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227e9f-abb1-4db6-b73f-29b327707e72 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.819673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.820910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.821111 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.821593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.821779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.822086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.822363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.822679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.823145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.824946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.834008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.836592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 927/1841] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:23.836920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415dc0-50cf-44cd-b1e5-43e2fe253af3 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.841017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:23.849555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 915/1842] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:23.871639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba2c4-1ba7-45a8-926f-1c2ba586f06e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:23.878419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:23.879447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.879834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.880562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] PATH_INFO: `/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e/users/e832219a7736469e820baf72ee52bce5/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.882808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fd8e64782d4c01a1e95b3e8f57668e, user_id=e832219a7736469e820baf72ee52bce5, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:23.886084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:23.900030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 928/1843] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:23 2022] PUT /identity/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e/users/e832219a7736469e820baf72ee52bce5/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:23.910326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:23.910690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:23.911025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:23.944331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] MFA Rules not processed for user `e832219a7736469e820baf72ee52bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:23.946026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.044419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 916/1844] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:24.055737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:24.057937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.158378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82c94-163a-4b74-b9bf-feb5b3e2535e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:24.162196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:24.162858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.163277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.168302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.174249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:24.175824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:24.186607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 929/1845] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:24.335564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:24.338048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.372028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:24.373517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.487783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac5f0-668d-4fad-8db7-7b99ca3ad064 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:24.492626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:24.493994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.494927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.495569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] PATH_INFO: `/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.497999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8aa42c930d4b4abf69c12e8f1128bc)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:24.503998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:24.519120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc524c2-7c94-4880-ba6e-01ff6d416a7b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:24.534903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:24.535808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.537932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.538886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] PATH_INFO: `/v3/projects/0506bae39c8a413c8a661219085cdc17` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.540520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0506bae39c8a413c8a661219085cdc17)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:24.544045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:24.664264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8aa42c930d4b4abf69c12e8f1128bc', 'request_id': 'req-ba7977c8-656e-4ac2-9838-27d84d9513cc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.672909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8aa42c930d4b4abf69c12e8f1128bc', 'request_id': 'req-ba7977c8-656e-4ac2-9838-27d84d9513cc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.679762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8aa42c930d4b4abf69c12e8f1128bc', 'request_id': 'req-ba7977c8-656e-4ac2-9838-27d84d9513cc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.710917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0506bae39c8a413c8a661219085cdc17', 'request_id': 'req-168ea426-673a-477d-a51c-896b9152ff5b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.775837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] The token cache is being invalidate because project dc8aa42c930d4b4abf69c12e8f1128bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:24.776210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.776941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ba7977c8-656e-4ac2-9838-27d84d9513cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.779379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 917/1846] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:24 2022] DELETE /identity/v3/projects/dc8aa42c930d4b4abf69c12e8f1128bc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:24.784044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.784340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.784655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.810231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:24.811435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.854687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0506bae39c8a413c8a661219085cdc17', 'request_id': 'req-168ea426-673a-477d-a51c-896b9152ff5b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.866132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0506bae39c8a413c8a661219085cdc17', 'request_id': 'req-168ea426-673a-477d-a51c-896b9152ff5b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.877377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] The token cache is being invalidate because project 0506bae39c8a413c8a661219085cdc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:24.877636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.878412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:24.882961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 930/1847] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:24 2022] DELETE /identity/v3/projects/0506bae39c8a413c8a661219085cdc17 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:24.882961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:24.882961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.896444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 918/1848] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:24.896444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:24.896723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea426-673a-477d-a51c-896b9152ff5b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:24.897911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:24.901449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:24.902418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.902764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.903099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] PATH_INFO: `/v3/users/5d740a97f5994a39b5e1f23f8b81a095` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.904387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d740a97f5994a39b5e1f23f8b81a095)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:24.906384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:24.912603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612ae57-144a-4dec-b579-076766fb21fd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:24.919387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:24.920555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:24.920839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:24.921114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] PATH_INFO: `/v3/users/a34563f04b5b4f428bb7c6c1b5a6cdec` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:24.922331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34563f04b5b4f428bb7c6c1b5a6cdec)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:24.924323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.091468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d740a97f5994a39b5e1f23f8b81a095'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.092428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d740a97f5994a39b5e1f23f8b81a095'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.098915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d740a97f5994a39b5e1f23f8b81a095'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.119836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34563f04b5b4f428bb7c6c1b5a6cdec'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.120467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34563f04b5b4f428bb7c6c1b5a6cdec'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.164125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d740a97f5994a39b5e1f23f8b81a095'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.176354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ba02614b-681e-483e-b7f1-7b833b4a0322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d740a97f5994a39b5e1f23f8b81a095'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.182856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 931/1849] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:24 2022] DELETE /identity/v3/users/5d740a97f5994a39b5e1f23f8b81a095 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:25.185744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.185744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.185744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.201917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:25.203160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:25.233247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34563f04b5b4f428bb7c6c1b5a6cdec'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.240944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34563f04b5b4f428bb7c6c1b5a6cdec'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.254951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eaf22853-84ac-45ba-ae42-c35d2e6d117c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34563f04b5b4f428bb7c6c1b5a6cdec'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:25.267199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 919/1850] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:24 2022] DELETE /identity/v3/users/a34563f04b5b4f428bb7c6c1b5a6cdec => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:25.267199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.267199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.267199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.271656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 932/1851] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:25.275695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.286665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710870f3-440b-4008-831f-6e9f2a27f429 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.294392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:25.294392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:25.372222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.373228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.373510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.373784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.374506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:25.374949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.377190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.391830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 933/1852] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:25.396796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.406970 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 920/1853] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:25.413509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be56b6-8ded-4978-9e2c-b05fc22ba718 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.419836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.420004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.420004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.420187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.420411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.421105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.421692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:25.423003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.486642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0bd79-daa4-4769-8129-ee72713dbea4 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.491708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.492620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.493017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.493349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.512386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.512386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.544148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 921/1854] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:25.561892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 934/1855] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:25 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:25.565657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.575482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9426fb-a406-498a-889f-54d75e2f1ecb service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.649072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.650030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.650370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.650713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.651477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.653810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.789162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 922/1856] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:25 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:25.793886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.804862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546d97-2bd6-4c14-b79b-3f84fd374a2f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.813624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.813624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.813624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.813624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.813967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.814277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.821850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.825814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:25.828102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 935/1857] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:25.832018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.843914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294904-5786-44b6-98b6-b33819d5c129 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.849384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.850263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.851117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.851592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.852447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.854759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.863181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a70f-7640-4ca8-9cd8-874e45737647 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.867451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 936/1858] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:25.872029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:25.873745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.874976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.875642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.876070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] PATH_INFO: `/v3/projects/33fce05f31934a79b73128213d37f0a4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.877494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fce05f31934a79b73128213d37f0a4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.881038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:25.897837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d983431-22e4-43b1-9f55-7f6f0d3845b9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:25.916581 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:25.919753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:25.920798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:25.921176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] PATH_INFO: `/v3/projects/7eaa83ab29424c45825ac4345e4d49d6/users/e25933e4df704136a1c119f569302ed7/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:25.958334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eaa83ab29424c45825ac4345e4d49d6, user_id=e25933e4df704136a1c119f569302ed7, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:25.962054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75857977-ce58-4901-a7ed-7bbd923d3764 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.050899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 937/1859] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:25 2022] PUT /identity/v3/projects/7eaa83ab29424c45825ac4345e4d49d6/users/e25933e4df704136a1c119f569302ed7/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:26.053737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.054029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.054306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.070207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fce05f31934a79b73128213d37f0a4', 'request_id': 'req-05c453a8-e374-4d90-bd30-7a4347166089'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.085112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fce05f31934a79b73128213d37f0a4', 'request_id': 'req-05c453a8-e374-4d90-bd30-7a4347166089'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.085112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fce05f31934a79b73128213d37f0a4', 'request_id': 'req-05c453a8-e374-4d90-bd30-7a4347166089'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.100804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] MFA Rules not processed for user `e25933e4df704136a1c119f569302ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:26.102587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.178776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 938/1860] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:26.181400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] The token cache is being invalidate because project 33fce05f31934a79b73128213d37f0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:26.181722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.182378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-05c453a8-e374-4d90-bd30-7a4347166089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.183391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.183975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 923/1861] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:25 2022] DELETE /identity/v3/projects/33fce05f31934a79b73128213d37f0a4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:26.189373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.189662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.189937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.207238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:26.208463 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.253945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63751-2d7a-4616-a1cd-1e12ae8bfef5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.259604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.260645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.260977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.261349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.262139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.264283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bc81-90c9-45f2-83bb-e0f48c2af311 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.277791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 924/1862] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:26.279527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.280957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.294111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020e78e-a2e0-4405-ad2c-3dbd537e2a51 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.298779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.299629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.299905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.300177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] PATH_INFO: `/v3/projects/cfe2e36d262b4aebb7c5e6e0839cfae7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.301357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe2e36d262b4aebb7c5e6e0839cfae7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.303226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.331701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 939/1863] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:26.333182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.333484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.333763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.353174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:26.354422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.409382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe2e36d262b4aebb7c5e6e0839cfae7', 'request_id': 'req-e003ebcf-94ae-4531-8f72-f4757e16a23f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.411704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 940/1864] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:26.412550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.413820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.416309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe2e36d262b4aebb7c5e6e0839cfae7', 'request_id': 'req-e003ebcf-94ae-4531-8f72-f4757e16a23f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.422233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe2e36d262b4aebb7c5e6e0839cfae7', 'request_id': 'req-e003ebcf-94ae-4531-8f72-f4757e16a23f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.425405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeec27-1f7e-4570-ae6a-4c2eea63e972 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.479236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.479897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.480173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.480471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.481142 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.481713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] The token cache is being invalidate because project cfe2e36d262b4aebb7c5e6e0839cfae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:26.482012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.482646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.483041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.484307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 925/1865] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:26 2022] DELETE /identity/v3/projects/cfe2e36d262b4aebb7c5e6e0839cfae7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:26.485093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.496177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.509050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003ebcf-94ae-4531-8f72-f4757e16a23f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.514251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.514922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.515207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.515481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.516207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:26.516626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.518209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.530732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 926/1866] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:26.531733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.535393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.548668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902c51b-16b9-4253-8b16-00138603c169 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.553454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.554404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.554689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.554964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] PATH_INFO: `/v3/users/e832219a7736469e820baf72ee52bce5` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.556670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e832219a7736469e820baf72ee52bce5)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.558625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.581141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 941/1867] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:26.582427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.594415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce53ff-b0a3-48a9-915d-e233afbd2abf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.599304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.600247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.600247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.600598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.601275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.603181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.737657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 942/1868] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:26.738781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.743347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.762344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e832219a7736469e820baf72ee52bce5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.762344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e832219a7736469e820baf72ee52bce5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.838580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e832219a7736469e820baf72ee52bce5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.839845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae8ef-6c2e-4d2b-ad64-55590eb8fdf8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.844766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.845436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.845709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.846038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.854036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.854173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e832219a7736469e820baf72ee52bce5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.854256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.865733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 943/1869] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:26.865733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.865733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.877116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e832219a7736469e820baf72ee52bce5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:26.882853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac759-d6cc-4e60-bd06-03c9311d44d1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.888465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 927/1870] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:26 2022] DELETE /identity/v3/users/e832219a7736469e820baf72ee52bce5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:26.899779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:26.901602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:26.903207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.904199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.904519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.910742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:26.910742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:26.914600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:26.983084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d840cb-93fc-4953-aff8-3c1222c96929 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:26.988113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:26.989154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:26.989466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:26.989836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] PATH_INFO: `/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c/users/5cb530a87fc04d1d8693ae5cfaa92f05/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.006383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb8bd3622974bf5bf297f24d479fa8c, user_id=5cb530a87fc04d1d8693ae5cfaa92f05, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.009938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.033884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 944/1871] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:26 2022] POST /identity/v3/users => generated 280 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:27.037847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.048008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f54a-0d7e-44eb-a413-55e3225bc688 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.052681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.053333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.055395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.055395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.055395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.056146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.066241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 945/1872] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:27.069997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.083388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456792-e9bc-4590-90a4-d9d4825ee6ec admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.095460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.096388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.096705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.097025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.097966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.099758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.106521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 928/1873] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:26 2022] PUT /identity/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c/users/5cb530a87fc04d1d8693ae5cfaa92f05/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:27.110540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.123987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 946/1874] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:27.127318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.138657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467183d-7523-4481-b031-539511d0f1f6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.201558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5164f1-e898-4179-bdf5-db724558417c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.207171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.207929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.208284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.208648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.209436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.209715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.210840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.211297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.211585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.212022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] PATH_INFO: `/v3/projects/f65564fa86954a158da9bd8b0ff90d9b/users/da7d26f9cb1e43c4908b077d895f4f36/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.224442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 929/1875] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:27.228910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.234864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65564fa86954a158da9bd8b0ff90d9b, user_id=da7d26f9cb1e43c4908b077d895f4f36, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.237832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516d15-6a32-4eeb-a6af-b692e5f57dfa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.246094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a485-a6ab-4cc1-bf95-f2589644497e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.250959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.252144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.252532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.252809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] PATH_INFO: `/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c/users/5cb530a87fc04d1d8693ae5cfaa92f05/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.257317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb8bd3622974bf5bf297f24d479fa8c, user_id=5cb530a87fc04d1d8693ae5cfaa92f05, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.257983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934cd68-0765-4383-be9f-d002f70f6472 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.269283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 930/1876] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:27 2022] PUT /identity/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c/users/5cb530a87fc04d1d8693ae5cfaa92f05/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:27.280572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.281332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.281332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.326854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 947/1877] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:27 2022] PUT /identity/v3/projects/f65564fa86954a158da9bd8b0ff90d9b/users/da7d26f9cb1e43c4908b077d895f4f36/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:27.329115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.330500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.330795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.351266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] MFA Rules not processed for user `5cb530a87fc04d1d8693ae5cfaa92f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:27.352616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.371180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] MFA Rules not processed for user `da7d26f9cb1e43c4908b077d895f4f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:27.373259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.448656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 948/1878] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:27.458766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 931/1879] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:27.469986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.471347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.495249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.497315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.540376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e654bd-3a23-4ca1-a773-80b27b296bc5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.545014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.545661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.545943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.546214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.548210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.559978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f47e-a9d0-4cbc-b65a-a638de3653f1 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.563838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.564580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.564863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.565743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.573857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.575319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.584852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 932/1880] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:27.586248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.587832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.613918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.615352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.624424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 949/1881] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:27.627218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:27.673848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc27a7a-ca27-4fb4-b370-1b65534665ae service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.678567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.679435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.679798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.680066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] PATH_INFO: `/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.681243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fd8e64782d4c01a1e95b3e8f57668e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.683258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.698475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0616-d221-4572-90e5-edfc772a0cb8 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:27.703503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:27.704409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.704747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.704966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] PATH_INFO: `/v3/users/da7d26f9cb1e43c4908b077d895f4f36` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.706310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7d26f9cb1e43c4908b077d895f4f36)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:27.709240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:27.822812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fd8e64782d4c01a1e95b3e8f57668e', 'request_id': 'req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.829314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fd8e64782d4c01a1e95b3e8f57668e', 'request_id': 'req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.835017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fd8e64782d4c01a1e95b3e8f57668e', 'request_id': 'req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.895538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] The token cache is being invalidate because project 70fd8e64782d4c01a1e95b3e8f57668e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:27.895832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.896507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25d4dbbb-a5c7-4b05-b5c0-d22277a479a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.898327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 933/1882] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:27 2022] DELETE /identity/v3/projects/70fd8e64782d4c01a1e95b3e8f57668e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:27.903548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190da4f-d5be-48d5-8353-5817b5c1f137 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.903837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190da4f-d5be-48d5-8353-5817b5c1f137 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.904112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190da4f-d5be-48d5-8353-5817b5c1f137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:27.908515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7d26f9cb1e43c4908b077d895f4f36'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.909386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7d26f9cb1e43c4908b077d895f4f36'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.916713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7d26f9cb1e43c4908b077d895f4f36'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:27.923597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1190da4f-d5be-48d5-8353-5817b5c1f137 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:27.926272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1190da4f-d5be-48d5-8353-5817b5c1f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:27.985834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 934/1883] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:27.994939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:27.995227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:27.995500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.010612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7d26f9cb1e43c4908b077d895f4f36'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:28.015852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:28.017294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:28.026956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 935/1884] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:28.027798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2df494d7-fb6b-458a-8d9a-61d89deff1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7d26f9cb1e43c4908b077d895f4f36'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:28.030883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.035053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 950/1885] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:27 2022] DELETE /identity/v3/users/da7d26f9cb1e43c4908b077d895f4f36 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:28.039824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.040675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.041157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.044227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857e53c-7acd-4763-ae1d-de507dc42ac6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.059496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:28.060979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:28.108979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.110699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.110699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.110699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.111000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:28.111193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.112886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.125430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 936/1886] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:28.129798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.144155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0e29-52ab-47ba-a69d-fd90016638fa admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.150987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.151672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.151936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.152212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.153030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.154909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.166746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 951/1887] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:28.177133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.178967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:28.262949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 937/1888] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:28 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:28.267106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.355774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac98e-8d18-4127-9074-7d6cd9aaba58 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.364317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.365678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.366147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.367045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.367953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.370897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.396731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04fa96-e1fa-4639-942a-7c524f0b3ca0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.450560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.451317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.451528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.451801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.461705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.462598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.473085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 952/1889] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:28.478288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 938/1890] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:28 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:28.479565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.494756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b12c1-910d-4898-bf19-88b7237ed5e7 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.500892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.501651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.502221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.502554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.503346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.505413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.519948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 953/1891] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:28.523983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.534277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941d8a-0e12-4812-a114-666fac325c9f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.539915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.541431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.541806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.542170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.543449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.545944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95805228-b707-45e1-b736-c0a153dbcd4c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.562267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 939/1892] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:28.563122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.574958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128470a7-91a0-495f-a82a-5fd0d5555d64 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.581708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.582912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.584567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.584567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] PATH_INFO: `/v3/projects/88c42579a98e4777bf5ffee3bba07e2b/users/0493231594df4a0a8968f2ed1a3a5990/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.600764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c42579a98e4777bf5ffee3bba07e2b, user_id=0493231594df4a0a8968f2ed1a3a5990, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.604558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.690658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 954/1893] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:28 2022] PUT /identity/v3/projects/88c42579a98e4777bf5ffee3bba07e2b/users/0493231594df4a0a8968f2ed1a3a5990/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:28.700622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.700911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.701182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.730851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] MFA Rules not processed for user `0493231594df4a0a8968f2ed1a3a5990`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:28.732049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:28.812609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 940/1894] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:28.817525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.882121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f48d4-b4b5-4bed-806c-4ae39d5fa14f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:28.890623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:28.892570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:28.892770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:28.893046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:28.896821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:28.902863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:28.993127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:28.995199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.000918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 955/1895] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:28 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:29.002110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.014798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7c6a-4137-42dd-8af4-ba84ca480f5a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.077690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.078563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.078839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.079109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] PATH_INFO: `/v3/projects/f65564fa86954a158da9bd8b0ff90d9b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.080293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65564fa86954a158da9bd8b0ff90d9b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.082363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.082868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1d29-cc01-47f3-b475-feedd5900734 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.088614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.089471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.089756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.090039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.090715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.092707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.204712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 956/1896] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:29.208488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.218887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262c7c4-b163-4d51-a6ab-0e6d81be2a6f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.223535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.224273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.224604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.225739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.225961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.227792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.241834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 957/1897] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:29.244686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.254563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65564fa86954a158da9bd8b0ff90d9b', 'request_id': 'req-0375655b-ae32-4283-8964-de2181022321'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:29.260634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8e903-e3b8-480d-b0ef-54da0d983e8d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.262166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65564fa86954a158da9bd8b0ff90d9b', 'request_id': 'req-0375655b-ae32-4283-8964-de2181022321'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:29.277865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65564fa86954a158da9bd8b0ff90d9b', 'request_id': 'req-0375655b-ae32-4283-8964-de2181022321'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:29.328261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.329193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.329644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.329762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] PATH_INFO: `/v3/projects/ba76af05206f46759f839f10e74b2e24/users/0c2add3e6fe84336822db62074ac542c/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.342347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] The token cache is being invalidate because project f65564fa86954a158da9bd8b0ff90d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:29.342891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:29.343699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0375655b-ae32-4283-8964-de2181022321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:29.346711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 941/1898] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:28 2022] DELETE /identity/v3/projects/f65564fa86954a158da9bd8b0ff90d9b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:29.352760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3782-a221-44a0-a5eb-dcdec3fd5987 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.357884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3782-a221-44a0-a5eb-dcdec3fd5987 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.358000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba76af05206f46759f839f10e74b2e24, user_id=0c2add3e6fe84336822db62074ac542c, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.358095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3782-a221-44a0-a5eb-dcdec3fd5987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.358191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.373686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2e2a3782-a221-44a0-a5eb-dcdec3fd5987 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:29.375674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2e2a3782-a221-44a0-a5eb-dcdec3fd5987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.389524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 942/1899] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:29.398034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.398717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.399513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.422622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:29.423969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.431721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 958/1900] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:29 2022] PUT /identity/v3/projects/ba76af05206f46759f839f10e74b2e24/users/0c2add3e6fe84336822db62074ac542c/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:29.435935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.437752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.507412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 943/1901] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:29.508655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.515280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa582-765e-4cd6-9799-eeb90b6f9434 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.521331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.521530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ab45-f1e2-479e-b955-e67e8634eaca None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.522015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.522326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.522563 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.523292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.525608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.528093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.528871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.529292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.529644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.530457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:29.530856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.532764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.539746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 959/1902] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:29.543762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.549811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 944/1903] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:29.554049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.557889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011811-736a-4772-8809-7054fa52a638 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.563890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.564947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.565330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.565706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] PATH_INFO: `/v3/projects/ba76af05206f46759f839f10e74b2e24/users/0c2add3e6fe84336822db62074ac542c/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.565882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fa49c-91fa-4569-bedd-65a67b0de223 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.568067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba76af05206f46759f839f10e74b2e24, user_id=0c2add3e6fe84336822db62074ac542c, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.571193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66e303-c2b4-4266-8b7d-fdc2a4dcebf1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.573088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.573813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.574303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.580712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.580712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.580712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.586204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 960/1904] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:29 2022] PUT /identity/v3/projects/ba76af05206f46759f839f10e74b2e24/users/0c2add3e6fe84336822db62074ac542c/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:29.599376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.601423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.601423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.638400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] MFA Rules not processed for user `0c2add3e6fe84336822db62074ac542c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:29.639738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.660383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 945/1905] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:29.661858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.751361 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca8c1-489f-4ef2-93de-4c2a3abd1f1c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.775767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.776800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.777151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.777538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.778373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.780589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.787739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 961/1906] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:29.799033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.800461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:29.866219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fdaf2-f408-4a51-a5ae-f1829e91aa53 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.881240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 946/1907] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:29 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:29.883161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.896637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55b29-c8e3-4d3d-96e6-17a051e32921 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.902745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.906309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.906309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.906309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.906309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.906578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.924618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 947/1908] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:29.926599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.938397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4006c1-37fd-4dd4-b952-d30118d13e47 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.943891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.944602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.944921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.945225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.945949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:29.948274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:29.955549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.956205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.956549 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.956819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.963347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 948/1909] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:29.964530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:29.974676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f9eb-9812-4dac-9444-49605f265848 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:29.980999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:29.981909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:29.982189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:29.982515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] PATH_INFO: `/v3/projects/351fe17327d14798b1eb1880341e6937/users/93e76b0776bd4b588b23327203229df8/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:29.999813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351fe17327d14798b1eb1880341e6937, user_id=93e76b0776bd4b588b23327203229df8, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:30.002653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:30.027912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:30.029653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc16f1-dbd1-4e34-91ae-fabd592ccf54 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:30.039576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 962/1910] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:30.096734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 949/1911] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:29 2022] PUT /identity/v3/projects/351fe17327d14798b1eb1880341e6937/users/93e76b0776bd4b588b23327203229df8/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:30.105752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:30.106098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:30.106393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:30.125589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:30.126942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:30.201655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:30.203517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:30.226521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 963/1912] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:30.240770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:30.240770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:30.285666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bcfb-09ef-48d4-93a8-16f28a6b9a91 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:30.289968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:30.291340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:30.291577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:30.291891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:30.294180 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:30.310544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71dbf-cfb1-4a77-b9d1-7b740ee501fe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:30.315772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:30.317031 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:30.317498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:30.318258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:30.334264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:30.339309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:30.351220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 964/1913] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:30.371108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:30.373110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9f03d-2a03-4888-b12d-642657a1f1ee service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:30.384663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 950/1914] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:30.983494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:30.996967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b618b3-17bf-41cc-93fe-042843f5ee98 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:31.003091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:31.003991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:31.004270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:31.004623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] PATH_INFO: `/v3/users/0493231594df4a0a8968f2ed1a3a5990` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:31.008223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0493231594df4a0a8968f2ed1a3a5990)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:31.010088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:31.262359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0493231594df4a0a8968f2ed1a3a5990'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:31.262952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0493231594df4a0a8968f2ed1a3a5990'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:31.277044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0493231594df4a0a8968f2ed1a3a5990'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:31.641827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0493231594df4a0a8968f2ed1a3a5990'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:31.641827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0493231594df4a0a8968f2ed1a3a5990'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:31.641827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 965/1915] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:30 2022] DELETE /identity/v3/users/0493231594df4a0a8968f2ed1a3a5990 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103370-9ad2-4ba7-91b6-dcfb26274bb2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103370-9ad2-4ba7-91b6-dcfb26274bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103370-9ad2-4ba7-91b6-dcfb26274bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a6103370-9ad2-4ba7-91b6-dcfb26274bb2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a6103370-9ad2-4ba7-91b6-dcfb26274bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:31.642329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 951/1916] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:31.643324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:31.643324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:31.643324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e228e7-77c3-4ed2-9811-6b025fa7d3cc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:31.644155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:31.644155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:31.644155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:31.644155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:31.644801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:31.644801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:31.644801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 966/1917] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:32.347869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:32.348162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:32.348762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:32.380221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] MFA Rules not processed for user `93e76b0776bd4b588b23327203229df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:32.381552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:32.456913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 952/1918] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:32.465463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:32.466897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:32.539474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e746516-f2c3-469c-ae0f-5daf4f881546 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:32.544622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:32.545384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:32.545739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:32.546087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:32.557665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:32.559316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:32.571022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 967/1919] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:32.924168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:32.926499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:32.942994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06d2a-d10d-48d1-97ed-5fa6c09debe7 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:32.959458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:32.960548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:32.960884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:32.961176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] PATH_INFO: `/v3/projects/88c42579a98e4777bf5ffee3bba07e2b` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:32.963360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c42579a98e4777bf5ffee3bba07e2b)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:32.966464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:33.121903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c42579a98e4777bf5ffee3bba07e2b', 'request_id': 'req-ca1dafdd-e082-4700-b427-0e950731bd46'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.129960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c42579a98e4777bf5ffee3bba07e2b', 'request_id': 'req-ca1dafdd-e082-4700-b427-0e950731bd46'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.145762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c42579a98e4777bf5ffee3bba07e2b', 'request_id': 'req-ca1dafdd-e082-4700-b427-0e950731bd46'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.182767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:33.185049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:33.197401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4eeb1-83fb-4b63-bdde-9257279f133a service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:33.215984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] The token cache is being invalidate because project 88c42579a98e4777bf5ffee3bba07e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:33.216789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.223889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.223889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 953/1920] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:32 2022] DELETE /identity/v3/projects/88c42579a98e4777bf5ffee3bba07e2b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:33.225352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:33.228646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:33.282418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:33.283585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:33.283886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:33.284143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:33.286034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:33.313264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafdd-e082-4700-b427-0e950731bd46 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:33.318632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:33.319591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:33.319948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:33.320480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] PATH_INFO: `/v3/users/0c2add3e6fe84336822db62074ac542c` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:33.322598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2add3e6fe84336822db62074ac542c)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:33.325322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:33.415837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:33.417543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:33.430464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 968/1921] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:33.575886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2add3e6fe84336822db62074ac542c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.576770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2add3e6fe84336822db62074ac542c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.655788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2add3e6fe84336822db62074ac542c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.672098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2add3e6fe84336822db62074ac542c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.694028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-664b541a-1948-44e0-b5a3-e29612fce155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2add3e6fe84336822db62074ac542c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:33.702287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 954/1922] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:33 2022] DELETE /identity/v3/users/0c2add3e6fe84336822db62074ac542c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:34.153343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:34.166335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18ce9-c6f4-4774-a204-53e849cb8910 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:34.251117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:34.252935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.253378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.253800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] PATH_INFO: `/v3/projects/ba76af05206f46759f839f10e74b2e24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.255690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba76af05206f46759f839f10e74b2e24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:34.258904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:34.420564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3352a8-1b8b-4480-90ba-f7ea8d858b97 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.421454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3352a8-1b8b-4480-90ba-f7ea8d858b97 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.421978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3352a8-1b8b-4480-90ba-f7ea8d858b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.434930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba76af05206f46759f839f10e74b2e24', 'request_id': 'req-8372a3f9-8cbe-4090-b90d-b9398ae131f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:34.439581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ea3352a8-1b8b-4480-90ba-f7ea8d858b97 None None] MFA Rules not processed for user `93e76b0776bd4b588b23327203229df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:34.440840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ea3352a8-1b8b-4480-90ba-f7ea8d858b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:34.495879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 955/1923] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:34.501442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba76af05206f46759f839f10e74b2e24', 'request_id': 'req-8372a3f9-8cbe-4090-b90d-b9398ae131f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:34.507598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba76af05206f46759f839f10e74b2e24', 'request_id': 'req-8372a3f9-8cbe-4090-b90d-b9398ae131f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:34.521651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] The token cache is being invalidate because project ba76af05206f46759f839f10e74b2e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:34.521996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:34.523398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8372a3f9-8cbe-4090-b90d-b9398ae131f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:34.528466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 969/1924] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:34 2022] DELETE /identity/v3/projects/ba76af05206f46759f839f10e74b2e24 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:34.530155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.530453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.530735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.550269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:34.551795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:34.625472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 956/1925] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:34.635157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.635520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.638577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.668433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:34.669963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:34.680421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 970/1926] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:34.691474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:34.712193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd831222-53f8-458b-a84b-fa6c7dd8da60 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:34.723776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:34.724800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.725422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.725953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.728056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:34.731799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:34.733746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:34.758134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 957/1927] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:34.762566 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:34.773435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eea11-5ba3-4392-af57-00d421595811 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:34.779351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:34.780115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.780481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.780792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.781457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:34.783872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:34.875525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 971/1928] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:34 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:34.879967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:34.892150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc94b-b301-41a8-9cd4-fa4f8598ca76 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:34.970544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:34.971275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:34.971556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:34.971972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:34.972891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:34.974812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:35.134939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 958/1929] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:34 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:35.142759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:35.160404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f47d6-1e78-4087-8cf6-da50f2b0d528 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:35.161743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:35.162543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:35.162981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:35.163403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:35.164466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:35.166844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:35.178397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 972/1930] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:35.182860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:35.193128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee2a8-64d4-4bc3-833c-6037b681b292 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:35.198947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:35.199632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:35.199911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:35.200509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:35.201384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:35.202919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a17bb-2228-4fba-97eb-27317a704c22 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:35.214357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 959/1931] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:35.218677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:35.229296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab057-2d0b-4d9c-b20e-c6d99b1551b2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:35.234020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:35.234892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:35.235165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:35.235437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] PATH_INFO: `/v3/projects/c1fbfc8519b84b63afeb6f43d5340665/users/45f14773eb794a648beaace53f0e9e38/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:35.252914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fbfc8519b84b63afeb6f43d5340665, user_id=45f14773eb794a648beaace53f0e9e38, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:35.256489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:35.369644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 973/1932] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:35 2022] PUT /identity/v3/projects/c1fbfc8519b84b63afeb6f43d5340665/users/45f14773eb794a648beaace53f0e9e38/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:35.372659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:35.384446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:35.384446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:35.402750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] MFA Rules not processed for user `45f14773eb794a648beaace53f0e9e38`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:35.404052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:35.484282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 960/1933] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:35.506625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:35.508218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:35.586756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99293d59-ca10-4d7a-8cb3-92882467ef3f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:35.591493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:35.592209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:35.592592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:35.592854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:35.604406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:35.605583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263af3f-4cd3-4c2f-9e5d-88b6a0b281e7 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:35.615217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 974/1934] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:39.423795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:39.425314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:39.490223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9f8e-bae0-45f2-8c0e-69f9df90959b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:39.494646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:39.495509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:39.495794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:39.496065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] PATH_INFO: `/v3/users/e25933e4df704136a1c119f569302ed7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:39.497260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25933e4df704136a1c119f569302ed7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:39.499156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:39.693218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25933e4df704136a1c119f569302ed7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:39.693853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25933e4df704136a1c119f569302ed7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:39.781517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25933e4df704136a1c119f569302ed7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:39.792890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25933e4df704136a1c119f569302ed7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:39.812641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25933e4df704136a1c119f569302ed7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:39.819284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 961/1935] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:39 2022] DELETE /identity/v3/users/e25933e4df704136a1c119f569302ed7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:39.824381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:39.824912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:39.824912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:39.843046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:39.844586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:39.904844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 975/1936] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:39.914608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:39.916108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:39.977787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43051-09ad-4575-a162-c4d09104b6be admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:39.981469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:39.982118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:39.982396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:39.982669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:39.991736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:39.993264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:40.003131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 962/1937] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:40.446018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:40.447630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:40.466607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784c0bc-0b0d-4e07-93e0-557c3e3062c6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:40.474011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:40.474011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:40.474011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:40.474011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] PATH_INFO: `/v3/projects/7eaa83ab29424c45825ac4345e4d49d6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:40.476194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eaa83ab29424c45825ac4345e4d49d6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:40.479077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:40.576192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eaa83ab29424c45825ac4345e4d49d6', 'request_id': 'req-1389a6c6-68b6-4d5d-ae34-9b635ef22138'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.682355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eaa83ab29424c45825ac4345e4d49d6', 'request_id': 'req-1389a6c6-68b6-4d5d-ae34-9b635ef22138'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.688194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eaa83ab29424c45825ac4345e4d49d6', 'request_id': 'req-1389a6c6-68b6-4d5d-ae34-9b635ef22138'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.699761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] The token cache is being invalidate because project 7eaa83ab29424c45825ac4345e4d49d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:40.700056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.700716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.702320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 976/1938] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:40 2022] DELETE /identity/v3/projects/7eaa83ab29424c45825ac4345e4d49d6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:40.708905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:40.716985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318792db-e53e-41d5-9a54-f479a4fe6f38 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:40.787130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:40.788014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:40.788317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:40.788688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] PATH_INFO: `/v3/users/5cb530a87fc04d1d8693ae5cfaa92f05` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:40.789996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb530a87fc04d1d8693ae5cfaa92f05)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:40.791941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:40.984098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb530a87fc04d1d8693ae5cfaa92f05'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:40.985977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb530a87fc04d1d8693ae5cfaa92f05'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.061591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb530a87fc04d1d8693ae5cfaa92f05'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.070349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb530a87fc04d1d8693ae5cfaa92f05'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.094643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1a8b861f-9b4d-43b9-ac48-bef91aecd0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb530a87fc04d1d8693ae5cfaa92f05'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.109033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 963/1939] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:40 2022] DELETE /identity/v3/users/5cb530a87fc04d1d8693ae5cfaa92f05 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:41.613902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:41.616914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:41.635670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389a6c6-68b6-4d5d-ae34-9b635ef22138 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:41.721068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:41.721955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:41.722238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:41.722504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] PATH_INFO: `/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:41.725666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb8bd3622974bf5bf297f24d479fa8c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:41.728288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:41.825595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb8bd3622974bf5bf297f24d479fa8c', 'request_id': 'req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.893900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb8bd3622974bf5bf297f24d479fa8c', 'request_id': 'req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.900428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb8bd3622974bf5bf297f24d479fa8c', 'request_id': 'req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.911618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] The token cache is being invalidate because project 8cb8bd3622974bf5bf297f24d479fa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:41.911905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.912584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4a5cc036-a5a1-4d91-bd22-eb2f0cd9412a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:41.914148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 977/1940] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:41 2022] DELETE /identity/v3/projects/8cb8bd3622974bf5bf297f24d479fa8c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:41.921883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:41.927185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:41.927185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:41.940110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:41.941338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:42.000525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 964/1941] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:42.007969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.008256 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.008633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.030433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:42.030935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:42.039299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 978/1942] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:42.044465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.054821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df8463-18ff-43f5-9943-d3d8c2e18b0a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.059894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.060565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.060893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.061173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.061924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:42.062224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.063849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.079879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 965/1943] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:42.088410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.098740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0179a-4a6d-4c61-8709-e58a102121ed None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.103207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.103883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.104160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.104469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.105242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.107224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.179688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 979/1944] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:42.180984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.195406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad12e0-74a1-4d90-9a7f-43f7152f11e3 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.266578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.267405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.267746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.268115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.269087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.271137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.360546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 966/1945] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:42 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:42.367444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.375643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e03fc-b7b0-49b6-be85-d856e81d453e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.380603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.381343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.381696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.382038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.382835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.385022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.398679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 980/1946] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:42.403088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.413224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541326d-13fd-41df-b7d5-378a0f332749 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.418145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.418808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.419084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.419358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.423924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.423924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd276d9-d170-47a7-820b-15c47f13dc3a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.435842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 967/1947] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:42.437877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.457361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f438-460a-4b4d-a59b-bd49dda4b812 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.465954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.466806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.467090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.467365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] PATH_INFO: `/v3/projects/0764f7ee5a5f493aa7b27c31168a9609/users/82687308e9b14480a659f6aadcb81e53/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.486842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0764f7ee5a5f493aa7b27c31168a9609, user_id=82687308e9b14480a659f6aadcb81e53, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.499130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.570926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 981/1948] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:42 2022] PUT /identity/v3/projects/0764f7ee5a5f493aa7b27c31168a9609/users/82687308e9b14480a659f6aadcb81e53/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:42.583068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.583397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.583682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.611323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] MFA Rules not processed for user `82687308e9b14480a659f6aadcb81e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:42.612573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:42.676103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 968/1949] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:42.694069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:42.694069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:42.756739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427e7e-0dd1-4884-bcc8-9abfcb5fc8a0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:42.763272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:42.763947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:42.764228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:42.764555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:42.775102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:42.776856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:42.786948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 982/1950] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:46.229756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:46.232216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:46.298317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3da2ec-8853-4ed3-a5d3-17a3968edbd3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:46.302865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:46.303736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:46.304018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:46.304294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] PATH_INFO: `/v3/users/6a63a5e7c4f54d6499fa4635e7885aab` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:46.305512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a63a5e7c4f54d6499fa4635e7885aab)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:46.307421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:46.481440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a63a5e7c4f54d6499fa4635e7885aab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:46.482137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a63a5e7c4f54d6499fa4635e7885aab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:46.552620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a63a5e7c4f54d6499fa4635e7885aab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:46.559731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a63a5e7c4f54d6499fa4635e7885aab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:46.572408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-13c2e67c-0785-4895-a08c-6273b6003398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a63a5e7c4f54d6499fa4635e7885aab'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:46.578976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 969/1951] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:46 2022] DELETE /identity/v3/users/6a63a5e7c4f54d6499fa4635e7885aab => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:46.800023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:46.811048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a8f4-c175-40ac-b1e3-2f90aca5ee97 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:46.869188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:46.870067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:46.870337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:46.870602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] PATH_INFO: `/v3/projects/b6b62c7e27134d3c814fb9ca90d6651f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:46.871778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b62c7e27134d3c814fb9ca90d6651f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:46.873672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:46.992357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b62c7e27134d3c814fb9ca90d6651f', 'request_id': 'req-7fae99a4-20a2-4041-a6a4-f4c6197ac166'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:47.064768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b62c7e27134d3c814fb9ca90d6651f', 'request_id': 'req-7fae99a4-20a2-4041-a6a4-f4c6197ac166'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:47.071920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b62c7e27134d3c814fb9ca90d6651f', 'request_id': 'req-7fae99a4-20a2-4041-a6a4-f4c6197ac166'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:47.083186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] The token cache is being invalidate because project b6b62c7e27134d3c814fb9ca90d6651f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:47.083471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:47.084108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7fae99a4-20a2-4041-a6a4-f4c6197ac166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:47.085669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 983/1952] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:46 2022] DELETE /identity/v3/projects/b6b62c7e27134d3c814fb9ca90d6651f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:47.090510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.090828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.091106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.109366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:47.110661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:47.176510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 970/1953] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:47.184087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.184087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.184087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.208183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:47.209648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:47.218674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 984/1954] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:47.222580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.233460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c433cc6-1e0b-4f57-af10-71d59f15ded0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.238205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.238867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.239145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.239413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.240127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:47.240455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.242043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.256569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 971/1955] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:47.258939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.268788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103040b-6146-4e9a-8e6d-b5979f77bf4d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.273412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.274622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.274904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.275174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.275868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.277888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.376651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 985/1956] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:47.380986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.391304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdb325-36f5-4e9c-82e7-23102d24b6ad admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.444994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.446173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.446465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.446739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.447434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.449379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.501242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 972/1957] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:47.505201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.516023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdd11-73d4-4957-8eb8-2d8bd0c1db8a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.520923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.521584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.521864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.522167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.523049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.525298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.535641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 986/1958] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:47.539691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.551379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6692-2d8c-4a8d-86fe-714355dd7cea admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.557618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.558304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.558584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.558857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.559566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.561204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e00a08-e219-4ceb-a652-f40c25e5d628 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.572547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 973/1959] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:47.576596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.587262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05e3c-ffbc-4609-aa9c-ff72275d2777 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.591809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.592706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.592983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.593251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] PATH_INFO: `/v3/projects/4e6dbc8d9ffd46279bda5e70fe43b614/users/5a238117172b4b18a53ef9d8782231a4/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.610387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6dbc8d9ffd46279bda5e70fe43b614, user_id=5a238117172b4b18a53ef9d8782231a4, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.613051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.689621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 987/1960] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:47 2022] PUT /identity/v3/projects/4e6dbc8d9ffd46279bda5e70fe43b614/users/5a238117172b4b18a53ef9d8782231a4/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:47.701249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.701546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.701826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.728591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] MFA Rules not processed for user `5a238117172b4b18a53ef9d8782231a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:47.729779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:47.791591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 974/1961] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:47.796311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.857596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a9f0-d1ed-4187-8a09-02dd70afe42d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:47.862741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:47.863431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:47.863706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:47.863976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:47.864712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:47.866630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:47.959159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 988/1962] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:47.963232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:47.974610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8aeb-17a2-41ab-86ce-b0d10c75309f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.029967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.030671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.030955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.031228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.031934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.033871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.112355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 975/1963] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:47 2022] POST /identity/v3/users => generated 309 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:48.116257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.127673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc671f-98fb-4bce-ac5a-28827cf5ddfe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.133424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.133424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.133424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.133782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.134362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.135954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.146261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 989/1964] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:48.150402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.160280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847052-fc39-4f3b-8afe-d3038e369417 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.165537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.166345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.166690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.166903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] PATH_INFO: `/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc/users/e38c8e24b2c648a0ad85767bba50fe17/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.183126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa5a1740dab4227bb05de83ae1ae6bc, user_id=e38c8e24b2c648a0ad85767bba50fe17, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.185848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.255371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 976/1965] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:48 2022] PUT /identity/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc/users/e38c8e24b2c648a0ad85767bba50fe17/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:48.259414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.269389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028dd1-6537-4b54-9040-6f78630d15ee admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.322617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.323268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.323546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.323817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.324574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.326277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42d94f-e1a6-4901-b93b-96c6dfd7e904 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.342617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 990/1966] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:48.346876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.358599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528771-9876-4887-b695-30e6f83181e1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.369656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.371421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.372456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.373292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] PATH_INFO: `/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc/users/e38c8e24b2c648a0ad85767bba50fe17/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.376078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa5a1740dab4227bb05de83ae1ae6bc, user_id=e38c8e24b2c648a0ad85767bba50fe17, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.379027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.396054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 977/1967] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:48 2022] PUT /identity/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc/users/e38c8e24b2c648a0ad85767bba50fe17/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:48.406916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.407207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.407486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.436730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] MFA Rules not processed for user `e38c8e24b2c648a0ad85767bba50fe17`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:48.437955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:48.519440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 991/1968] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:48.534648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.536383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:48.593416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7b9-d2c7-449c-a380-1354d42d5c3d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.597192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.597834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.598114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.598387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.607877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.609314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2070ed-cc05-43d3-8d2b-76aec057bf19 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:48.625619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 978/1969] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:48.783955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:48.851448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217514e6-f4a7-4880-9e44-5117b981c57c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:48.856033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:48.856937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:48.857218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:48.857487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] PATH_INFO: `/v3/users/5a238117172b4b18a53ef9d8782231a4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:48.858721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a238117172b4b18a53ef9d8782231a4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:48.860660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:49.097169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a238117172b4b18a53ef9d8782231a4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:49.097915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a238117172b4b18a53ef9d8782231a4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:49.104986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a238117172b4b18a53ef9d8782231a4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:49.192347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a238117172b4b18a53ef9d8782231a4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:49.205225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a238117172b4b18a53ef9d8782231a4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:49.213465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 992/1970] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:48 2022] DELETE /identity/v3/users/5a238117172b4b18a53ef9d8782231a4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:49.218057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:49.218392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:49.218668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:49.236673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:49.237866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:49.296863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 979/1971] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:49.307084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:49.308683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:49.370917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd61b6-0fa5-483d-adc8-26d363f775ee admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:49.374462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:49.375148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:49.375427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:49.375724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:49.386395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:49.387902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:49.400326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 993/1972] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:49.885622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:49.887024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:49.899734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8492-a576-4a1a-83ef-83e2e7d14bb3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:49.905154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:49.906232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:49.906657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:49.907063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] PATH_INFO: `/v3/projects/4e6dbc8d9ffd46279bda5e70fe43b614` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:49.909120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6dbc8d9ffd46279bda5e70fe43b614)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:49.912012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:50.044251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6dbc8d9ffd46279bda5e70fe43b614', 'request_id': 'req-5233dcbe-12ca-4082-a84c-e1110047ad36'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.050436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6dbc8d9ffd46279bda5e70fe43b614', 'request_id': 'req-5233dcbe-12ca-4082-a84c-e1110047ad36'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.056770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6dbc8d9ffd46279bda5e70fe43b614', 'request_id': 'req-5233dcbe-12ca-4082-a84c-e1110047ad36'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.150686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] The token cache is being invalidate because project 4e6dbc8d9ffd46279bda5e70fe43b614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:50.150966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.151577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.153158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 980/1973] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:49 2022] DELETE /identity/v3/projects/4e6dbc8d9ffd46279bda5e70fe43b614 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:50.157191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:50.167672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dddcb4-341f-4dbe-abac-1edd004c34bf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:50.227454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:50.228322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:50.228631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:50.228927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] PATH_INFO: `/v3/users/e38c8e24b2c648a0ad85767bba50fe17` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:50.230105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38c8e24b2c648a0ad85767bba50fe17)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:50.232017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:50.390781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38c8e24b2c648a0ad85767bba50fe17'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.390781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38c8e24b2c648a0ad85767bba50fe17'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.397248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38c8e24b2c648a0ad85767bba50fe17'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.443447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38c8e24b2c648a0ad85767bba50fe17'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.456297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6e893a72-3c2e-4494-973d-91b9e3ab27a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38c8e24b2c648a0ad85767bba50fe17'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:50.462884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 994/1974] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:50 2022] DELETE /identity/v3/users/e38c8e24b2c648a0ad85767bba50fe17 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:50.855656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:50.856728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:50.882127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dcbe-12ca-4082-a84c-e1110047ad36 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:50.964965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:50.969268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:50.969268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:50.969268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] PATH_INFO: `/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:50.969268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa5a1740dab4227bb05de83ae1ae6bc)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:50.969853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.074645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa5a1740dab4227bb05de83ae1ae6bc', 'request_id': 'req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:51.080668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa5a1740dab4227bb05de83ae1ae6bc', 'request_id': 'req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:51.085956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa5a1740dab4227bb05de83ae1ae6bc', 'request_id': 'req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:51.140090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] The token cache is being invalidate because project 4fa5a1740dab4227bb05de83ae1ae6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:51.140394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:51.141011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6ea85a43-eb91-4dd6-a2dc-86abbe397f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:51.142745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 981/1975] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:50 2022] DELETE /identity/v3/projects/4fa5a1740dab4227bb05de83ae1ae6bc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:51.147665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.147965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.148244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.166789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:51.168334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:51.226370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 995/1976] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:51.234745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.235033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.235310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.255076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:51.256271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:51.264311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 982/1977] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:51.268625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.278807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82a02-08fe-45f9-bb11-fad3245f3e61 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.283339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.283994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.284277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.284599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.285320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:51.285629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.287277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.299792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 996/1978] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:51.304284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.313983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b6b08-5c18-4653-af70-6599420490f9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.318609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.319273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.319531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.319802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.320506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.322372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.405337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 983/1979] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:51.409383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.420468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3040a1-bb32-482f-ad0f-b53b0e814a1c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.473182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.473841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.474125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.474396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.475066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.477661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.555924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 997/1980] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:51.556739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.567372 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9f3b-7874-4885-90f5-5a63dc4da7e8 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.574814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.575488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.575768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.576168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.576941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.578539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.594343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 984/1981] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:51.596498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.606064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce63ef-2e3a-4ff7-a62a-a4ec78abb597 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.610824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.611567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.611847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.612120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.612866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.614445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93728-4b4b-4d76-8e97-4f416d455781 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.624780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 998/1982] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:51.629042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.639477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3b47-4c5d-4f92-9811-277e100ff0e8 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.644174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.645134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.645462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.645738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] PATH_INFO: `/v3/projects/013553810cf44582abef1f6ae254ae46/users/4ac109d778b04d3895fd0851d062e985/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.660762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=013553810cf44582abef1f6ae254ae46, user_id=4ac109d778b04d3895fd0851d062e985, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.663464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:51.763527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 985/1983] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:51 2022] PUT /identity/v3/projects/013553810cf44582abef1f6ae254ae46/users/4ac109d778b04d3895fd0851d062e985/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:51.774371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.774658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.774929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.801678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] MFA Rules not processed for user `4ac109d778b04d3895fd0851d062e985`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:51.802893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:51.864518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 999/1984] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:51.868903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:51.927629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c304-095d-4b39-b4e6-fcfb8559de7e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:51.932247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:51.932947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:51.933226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:51.933499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:51.934190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:51.936198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.037146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 986/1985] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:51 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:52.038639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.051801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6f805-7daf-4375-8636-4c6b7d4f1cac None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.121213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.122060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.122412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.122727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.123645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.125596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.244186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1000/1986] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:52 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:52.248490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.259215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94023-e9e8-44b8-afa9-004173e37c1f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.263729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.264418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.264784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.264977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.265697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.267279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.277911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 987/1987] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:52.282080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.292074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07abb-eae4-4d02-8985-005101875f54 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.298261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.299191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.299819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.299819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] PATH_INFO: `/v3/projects/e65b84314ca64628b2998643e85c41e0/users/d9a1c9b9b5ff471286c703f5751c0acb/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.318050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65b84314ca64628b2998643e85c41e0, user_id=d9a1c9b9b5ff471286c703f5751c0acb, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.321819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.404003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1001/1988] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:52 2022] PUT /identity/v3/projects/e65b84314ca64628b2998643e85c41e0/users/d9a1c9b9b5ff471286c703f5751c0acb/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:52.408100 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.418515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564914b-d333-4b40-bcd7-4992ec713880 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.471841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.472533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.472819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.473095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.473810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.475410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80837-8160-4327-a106-e514e2e51b26 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.484780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 988/1989] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:52.489084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.499578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae7454-9b53-4922-83b2-d4523dd22d1c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.504174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.505079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.505360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.505631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] PATH_INFO: `/v3/projects/e65b84314ca64628b2998643e85c41e0/users/d9a1c9b9b5ff471286c703f5751c0acb/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.507584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65b84314ca64628b2998643e85c41e0, user_id=d9a1c9b9b5ff471286c703f5751c0acb, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.510921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.520720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1002/1990] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:52 2022] PUT /identity/v3/projects/e65b84314ca64628b2998643e85c41e0/users/d9a1c9b9b5ff471286c703f5751c0acb/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:52.530651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.530937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.531242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.558196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] MFA Rules not processed for user `d9a1c9b9b5ff471286c703f5751c0acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:52.559390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:52.628828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 989/1991] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:52.639565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.641258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:52.695940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebf5f-1e1d-4c45-a699-da200a7e0dbd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.699613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.700251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.700558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.700830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.709810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.711333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8c6c6-df28-4b87-9dc5-8142bc85fcde service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:52.721150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1003/1992] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:52.837986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:52.839772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:52.906462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217ab2-7448-4118-b4b5-a0b2f844bdf9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:52.911259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:52.912129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:52.912564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:52.912844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] PATH_INFO: `/v3/users/82687308e9b14480a659f6aadcb81e53` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:52.914706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82687308e9b14480a659f6aadcb81e53)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:52.916730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:53.113878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82687308e9b14480a659f6aadcb81e53'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:53.114461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82687308e9b14480a659f6aadcb81e53'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:53.196861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82687308e9b14480a659f6aadcb81e53'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:53.204995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82687308e9b14480a659f6aadcb81e53'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:53.217615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82687308e9b14480a659f6aadcb81e53'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:53.224685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 990/1993] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:52 2022] DELETE /identity/v3/users/82687308e9b14480a659f6aadcb81e53 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:53.229029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:53.229319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:53.229601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:53.246772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:53.247962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:53.310420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1004/1994] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:53.319593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:53.321040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:53.378490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a357-afb1-4a7f-8155-d34a0149cbe1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:53.382155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:53.382838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:53.383124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:53.386722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:53.392675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:53.394153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca874ba-c083-44fe-b740-f0a320557916 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:53.407759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 991/1995] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:53.885589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:53.887075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:53.899158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cca39-7fcb-4316-b734-f59013cfb20d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:53.903755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:53.905275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:53.905275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:53.905275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] PATH_INFO: `/v3/projects/0764f7ee5a5f493aa7b27c31168a9609` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:53.906326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0764f7ee5a5f493aa7b27c31168a9609)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:53.908308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.011684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0764f7ee5a5f493aa7b27c31168a9609', 'request_id': 'req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:54.087547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0764f7ee5a5f493aa7b27c31168a9609', 'request_id': 'req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:54.093558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0764f7ee5a5f493aa7b27c31168a9609', 'request_id': 'req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:54.105396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] The token cache is being invalidate because project 0764f7ee5a5f493aa7b27c31168a9609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:54.105683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:54.106352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca9bf98e-d995-4053-a7b9-e2011aa1d51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:54.107886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1005/1996] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:53 2022] DELETE /identity/v3/projects/0764f7ee5a5f493aa7b27c31168a9609 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:54.112843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.113258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.113429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.131159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:54.132339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:54.195357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 992/1997] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:54.198021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.198693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.198857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.222970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:54.224156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:54.232786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1006/1998] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:54.236964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.246778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c3d3d-ff76-4233-8349-0cc5f28f6fb3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.251273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.251912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.252190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.252490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.253201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:54.253499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.255065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.265986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 993/1999] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:25:54.270118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.279017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c613-675a-4fbd-8faa-2130655b0782 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.283607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.284263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.284573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.284843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.285526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.287414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.379642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1007/2000] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:54 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:54.380886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.390952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0a2d-8c1d-4ff9-91ee-d7402f9d4857 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.456977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.457660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.457935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.458360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.459069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.465955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.578328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 994/2001] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:54 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:54.579630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.590544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3071bd-6e7b-455b-a0d2-cd4e799a81bd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.595731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.596486 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.597067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.597067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.597820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.599349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.613988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1008/2002] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:54.615374 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.632244 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8ecf6-a3dd-454b-9526-1fd6725eab31 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.637164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.637857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.638137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.638409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.639166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.640976 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf75143-1cd5-407a-bc69-30f667e366fd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.652154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 995/2003] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:54.656434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.667927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e923c-c233-4c59-aba2-1e3fa0769e14 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.674435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.675784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.675784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.675990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] PATH_INFO: `/v3/projects/69736223e6c1479483a2883500ffdf59/users/4c198096896448129ef0571ff5fa9960/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.695442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69736223e6c1479483a2883500ffdf59, user_id=4c198096896448129ef0571ff5fa9960, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.698243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:54.785686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1009/2004] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:54 2022] PUT /identity/v3/projects/69736223e6c1479483a2883500ffdf59/users/4c198096896448129ef0571ff5fa9960/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:54.799484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.799748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.800238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.830034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] MFA Rules not processed for user `4c198096896448129ef0571ff5fa9960`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:54.831261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:54.904828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 996/2005] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:54.919345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:54.921215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:54.976904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a6230-3e73-4928-a076-90bed839570c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:54.980580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:54.981226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:54.981507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:54.981780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:54.990110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:54.991594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad877-f423-4d50-909b-34320c7e4934 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:55.000476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1010/2006] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:55.880518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:55.881979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:55.945960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f8d9-a60e-4459-9f69-05ec46575775 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:55.950387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:55.951272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:55.951547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:55.951812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] PATH_INFO: `/v3/users/4ac109d778b04d3895fd0851d062e985` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:55.952981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac109d778b04d3895fd0851d062e985)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:55.954897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:56.164221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac109d778b04d3895fd0851d062e985'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:56.164904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac109d778b04d3895fd0851d062e985'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:56.253150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac109d778b04d3895fd0851d062e985'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:56.260774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac109d778b04d3895fd0851d062e985'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:56.271996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac109d778b04d3895fd0851d062e985'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:56.277998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 997/2007] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:55 2022] DELETE /identity/v3/users/4ac109d778b04d3895fd0851d062e985 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:56.282858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:56.283374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:56.283465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:56.301078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:56.302262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:56.361435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1011/2008] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:25:56.372695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:56.374149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:56.429288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b5c07-7e2d-4a22-aa49-0fc55a62c311 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:56.433447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:56.434092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:56.434373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:56.434644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:56.443392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:56.444828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:56.453968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 998/2009] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:56.946039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:56.947546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:56.959537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbf2f-51b9-4196-88a7-5b6f2f8fde2b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:56.964947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:56.965815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:56.966137 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:56.966437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] PATH_INFO: `/v3/projects/013553810cf44582abef1f6ae254ae46` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:56.967742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013553810cf44582abef1f6ae254ae46)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:56.969654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:57.084855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013553810cf44582abef1f6ae254ae46', 'request_id': 'req-f3a7b585-a929-4625-95a5-a272f47c4d91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.157331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013553810cf44582abef1f6ae254ae46', 'request_id': 'req-f3a7b585-a929-4625-95a5-a272f47c4d91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.163066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013553810cf44582abef1f6ae254ae46', 'request_id': 'req-f3a7b585-a929-4625-95a5-a272f47c4d91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.174483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] The token cache is being invalidate because project 013553810cf44582abef1f6ae254ae46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:57.174856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.175551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.177176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1012/2010] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:56 2022] DELETE /identity/v3/projects/013553810cf44582abef1f6ae254ae46 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:57.182142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:57.191777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d14f9-a7a5-49b9-ba88-7aa3bb30946f service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:57.249626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:57.250504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:57.250783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:57.251055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] PATH_INFO: `/v3/users/d9a1c9b9b5ff471286c703f5751c0acb` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:57.252232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a1c9b9b5ff471286c703f5751c0acb)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:57.254217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:57.428043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a1c9b9b5ff471286c703f5751c0acb'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.428729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a1c9b9b5ff471286c703f5751c0acb'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.483409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a1c9b9b5ff471286c703f5751c0acb'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.490563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a1c9b9b5ff471286c703f5751c0acb'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.502596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a1c9b9b5ff471286c703f5751c0acb'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:57.509012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 999/2011] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:57 2022] DELETE /identity/v3/users/d9a1c9b9b5ff471286c703f5751c0acb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:57.914633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:57.916597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:57.931377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b585-a929-4625-95a5-a272f47c4d91 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:57.995049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:57.995912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:57.996203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:57.996509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] PATH_INFO: `/v3/projects/e65b84314ca64628b2998643e85c41e0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:57.997931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65b84314ca64628b2998643e85c41e0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.001740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.073825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.075265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.087927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea235e-db73-46b3-b814-4d1ee9468e15 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.092528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.093401 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.093681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.093953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] PATH_INFO: `/v3/users/4c198096896448129ef0571ff5fa9960` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.095132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c198096896448129ef0571ff5fa9960)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.097083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.113202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65b84314ca64628b2998643e85c41e0', 'request_id': 'req-2b8f356c-f387-4bcd-9b96-42172384bc3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.213309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65b84314ca64628b2998643e85c41e0', 'request_id': 'req-2b8f356c-f387-4bcd-9b96-42172384bc3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.222709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65b84314ca64628b2998643e85c41e0', 'request_id': 'req-2b8f356c-f387-4bcd-9b96-42172384bc3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.240936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] The token cache is being invalidate because project e65b84314ca64628b2998643e85c41e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:58.241235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.241896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b8f356c-f387-4bcd-9b96-42172384bc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.243469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1013/2012] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:57 2022] DELETE /identity/v3/projects/e65b84314ca64628b2998643e85c41e0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:58.248167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989761-c0b2-4c2d-b9c0-418409ffee5e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.248552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989761-c0b2-4c2d-b9c0-418409ffee5e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.248833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989761-c0b2-4c2d-b9c0-418409ffee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.266656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-49989761-c0b2-4c2d-b9c0-418409ffee5e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:58.268084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-49989761-c0b2-4c2d-b9c0-418409ffee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.313222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c198096896448129ef0571ff5fa9960'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.313871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c198096896448129ef0571ff5fa9960'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.326498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1014/2013] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:58.334506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.334802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.335079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.354672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:58.355842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.363912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1015/2014] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:58.368097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.376899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27416-a2d9-46de-a86f-6c20c976f471 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.381471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.382091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.382461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.382761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.383487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:25:58.383790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.385420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.396278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1016/2015] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:25:58.400769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.409764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173966c-f464-4d73-a686-4ed9afd70724 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.414910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.415502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.415789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.416064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.416748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.418812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.437235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c198096896448129ef0571ff5fa9960'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.444456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c198096896448129ef0571ff5fa9960'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.456929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cacde5b-6998-44c4-8258-343937b94e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c198096896448129ef0571ff5fa9960'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:58.463749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1000/2016] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:58 2022] DELETE /identity/v3/users/4c198096896448129ef0571ff5fa9960 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:58.468587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.468587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.468888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.486593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:58.487790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.529757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1017/2017] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:58.533745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.550677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1001/2018] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:58.561567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.563041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.598481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945db1c-01f3-4b34-a45b-563510cecd63 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.603280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.603948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.604230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.604531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.605266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.607173 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.619803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f36fc-9c57-4a6a-8698-b828b98e82b1 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.665577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.666212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.666490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.666762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.676183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1018/2019] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:58.682304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.682432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.682523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.689684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcaa0-ff37-43ce-8e89-5fa8febe63bc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.691585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1002/2020] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:25:58.694724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.695907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.696179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.696477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.697186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.698876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.712095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1019/2021] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:58.713533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.723092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f340e9-0a8a-4e14-98ac-81b2e438d9ce service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.727883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.728625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.728894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.729180 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.729888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.731564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7143a9-2e0b-4def-9ba8-eb904279963f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.741373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1003/2022] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:58.745514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:58.755897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19313414-ddf0-4fc9-b0ca-3b812871e0d3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:58.761331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:58.762268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.762548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.762820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] PATH_INFO: `/v3/projects/9046a33777914cf9a474684d9792bfc8/users/a7c6045af248434490b5c30bdc614b34/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.778560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9046a33777914cf9a474684d9792bfc8, user_id=a7c6045af248434490b5c30bdc614b34, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:58.781808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:58.884491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1020/2023] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:58 2022] PUT /identity/v3/projects/9046a33777914cf9a474684d9792bfc8/users/a7c6045af248434490b5c30bdc614b34/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:58.895907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:58.896265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:58.897370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:58.926111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] MFA Rules not processed for user `a7c6045af248434490b5c30bdc614b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:58.927302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:58.993161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1004/2024] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:59.004736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.066231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b10ca-7aed-43a3-8e96-67ec06d02884 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.071697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.072357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.072667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.072965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.073635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.075557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.091048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.092518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.109059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05788c-ee9a-4f71-ab2a-e2c2e2174381 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.114176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.115056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.115545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.115658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] PATH_INFO: `/v3/projects/69736223e6c1479483a2883500ffdf59` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.116804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69736223e6c1479483a2883500ffdf59)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.119217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.177440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1021/2025] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:25:59 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:25:59.182915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.227252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69736223e6c1479483a2883500ffdf59', 'request_id': 'req-5c5b56ba-1239-4046-9148-691832394c63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.234297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69736223e6c1479483a2883500ffdf59', 'request_id': 'req-5c5b56ba-1239-4046-9148-691832394c63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.239913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69736223e6c1479483a2883500ffdf59', 'request_id': 'req-5c5b56ba-1239-4046-9148-691832394c63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.249903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425f6f-17ad-4507-9a7a-ba9c002419d1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.303288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.303960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.304240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.305117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.320079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.320079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.320419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] The token cache is being invalidate because project 69736223e6c1479483a2883500ffdf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:25:59.320419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.320419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.320419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1005/2026] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:25:59 2022] DELETE /identity/v3/projects/69736223e6c1479483a2883500ffdf59 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:25:59.405416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1022/2027] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:25:59 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:25:59.406704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.408199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.422141 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b56ba-1239-4046-9148-691832394c63 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.426884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.427575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.427853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.428127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.428909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.431134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.445438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1006/2028] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:25:59.446896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.457210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3367e0-14bd-4d92-bc23-b8becfa7bd42 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.462333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.463241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.463519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.463791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] PATH_INFO: `/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb/users/1b3cb164d5ee432abc74bb00c7114d70/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.481146 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5922f81b1f2c4ffcafc9193be5abafeb, user_id=1b3cb164d5ee432abc74bb00c7114d70, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.483782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.551298 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.553055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.565365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1023/2029] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:59 2022] PUT /identity/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb/users/1b3cb164d5ee432abc74bb00c7114d70/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:59.566430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6496-23d3-482a-a81e-79fd8989c9ef admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.568933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.623584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.624488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.624773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.625051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] PATH_INFO: `/v3/users/45f14773eb794a648beaace53f0e9e38` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.626248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f14773eb794a648beaace53f0e9e38)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.628155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.630215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036153ab-50fb-4522-a3bd-4b7e3365719f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.636006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.636628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.636910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.637184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.637900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.639482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.649780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1024/2030] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:25:59.653757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.663133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f769-d731-4276-abdc-2b440f2f2123 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.668630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.669472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.669815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.670086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] PATH_INFO: `/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb/users/1b3cb164d5ee432abc74bb00c7114d70/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.672172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5922f81b1f2c4ffcafc9193be5abafeb, user_id=1b3cb164d5ee432abc74bb00c7114d70, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.674781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264749e-599a-4ef7-b10c-ff281db7005e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.684655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1025/2031] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:25:59 2022] PUT /identity/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb/users/1b3cb164d5ee432abc74bb00c7114d70/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:59.694767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.695106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.695406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.723752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] MFA Rules not processed for user `1b3cb164d5ee432abc74bb00c7114d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:59.724985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.792553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1026/2032] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:25:59.803995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.805605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.856926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f14773eb794a648beaace53f0e9e38'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.857554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f14773eb794a648beaace53f0e9e38'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.863736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f11e-491a-447e-b36e-ffc8cf034867 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:25:59.867394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:25:59.868031 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.868331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.868620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.870539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.881763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:25:59.883201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a363b4b-836d-47ce-9c3f-88b8a26a43fe service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:25:59.892524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1027/2033] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:25:59.922964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f14773eb794a648beaace53f0e9e38'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.931566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f14773eb794a648beaace53f0e9e38'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.945670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f14773eb794a648beaace53f0e9e38'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:25:59.953743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1007/2034] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:59 2022] DELETE /identity/v3/users/45f14773eb794a648beaace53f0e9e38 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:25:59.958301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:25:59.958871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:25:59.959165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:25:59.959442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:25:59.959753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:25:59.977670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:25:59.978854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.022429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e770fd-a32f-4116-ac8c-aca54255f711 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.027712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.028635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.028917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.029192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] PATH_INFO: `/v3/users/a7c6045af248434490b5c30bdc614b34` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.030427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c6045af248434490b5c30bdc614b34)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.032342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.038312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1028/2035] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:00.048805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.050190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.110355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2904-ba59-40b7-85f8-65d0f1e9b286 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.114200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.114901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.115204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.115472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.124824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.126252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52dc33-8e3f-48b5-aead-e63ac0313718 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.136059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1029/2036] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:26:00.183840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c6045af248434490b5c30bdc614b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.184694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c6045af248434490b5c30bdc614b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.232187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c6045af248434490b5c30bdc614b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.241562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c6045af248434490b5c30bdc614b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.253606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c6045af248434490b5c30bdc614b34'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.260610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1008/2037] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:25:59 2022] DELETE /identity/v3/users/a7c6045af248434490b5c30bdc614b34 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:00.265308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.265598 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.265874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.284399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:00.286374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.349565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1030/2038] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:00.359203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.360703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.416999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ad9db-c72c-4af2-999e-b4eae20f93e0 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.420968 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.421810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.422104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.422384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.432629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.434573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63128d4-042f-413a-9705-23ca424fe262 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.447245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1009/2039] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:00.559898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.565474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.580002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e9003-6b3b-49f2-9788-2e429a36a995 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.587457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.588334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.588678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.589061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] PATH_INFO: `/v3/projects/c1fbfc8519b84b63afeb6f43d5340665` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.593132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fbfc8519b84b63afeb6f43d5340665)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.593132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.711201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fbfc8519b84b63afeb6f43d5340665', 'request_id': 'req-750d4f3b-0060-4d75-9c6d-72fd64d06978'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.797177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fbfc8519b84b63afeb6f43d5340665', 'request_id': 'req-750d4f3b-0060-4d75-9c6d-72fd64d06978'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.803650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fbfc8519b84b63afeb6f43d5340665', 'request_id': 'req-750d4f3b-0060-4d75-9c6d-72fd64d06978'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.815416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] The token cache is being invalidate because project c1fbfc8519b84b63afeb6f43d5340665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:00.815754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.816488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:00.818011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1031/2040] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:00 2022] DELETE /identity/v3/projects/c1fbfc8519b84b63afeb6f43d5340665 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:00.822876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de83a-d737-4b06-9a35-38b5444026c1 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.823168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de83a-d737-4b06-9a35-38b5444026c1 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.823567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7de83a-d737-4b06-9a35-38b5444026c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.840891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-cd7de83a-d737-4b06-9a35-38b5444026c1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:00.842113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cd7de83a-d737-4b06-9a35-38b5444026c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.896029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.897478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.900856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1010/2041] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:00.911769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.912064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.912896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.923252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d4f3b-0060-4d75-9c6d-72fd64d06978 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.928036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.928936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.929214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.930220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] PATH_INFO: `/v3/projects/9046a33777914cf9a474684d9792bfc8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.931316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9046a33777914cf9a474684d9792bfc8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.933405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.934619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:00.935854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:00.944485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1011/2042] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:00.948726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.957819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545c1dc-d15f-4340-9c7f-758bf46a38c9 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.962530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.963107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.963545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.963819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.964575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:26:00.970854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:00.970854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:00.978764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1012/2043] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:26:00.982258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:00.991634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d2de-65f9-4f49-874d-ccf228f5c6d7 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:00.997171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:00.997825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:00.998106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:00.998381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:00.999079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.001081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.042764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9046a33777914cf9a474684d9792bfc8', 'request_id': 'req-359013c4-75fb-492c-8b09-092829b61216'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.106745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1013/2044] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:00 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:01.110746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.127433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9046a33777914cf9a474684d9792bfc8', 'request_id': 'req-359013c4-75fb-492c-8b09-092829b61216'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.133238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9046a33777914cf9a474684d9792bfc8', 'request_id': 'req-359013c4-75fb-492c-8b09-092829b61216'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.147383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] The token cache is being invalidate because project 9046a33777914cf9a474684d9792bfc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:01.147675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.148866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.150428 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1032/2045] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:00 2022] DELETE /identity/v3/projects/9046a33777914cf9a474684d9792bfc8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:01.154227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.155540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:01.177276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aff3c-9c9f-47ff-acb9-d682897e17a2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.183030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.183715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.184051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.184330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.185061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.187206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.220932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359013c4-75fb-492c-8b09-092829b61216 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.225500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.227004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.227282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.227548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] PATH_INFO: `/v3/users/1b3cb164d5ee432abc74bb00c7114d70` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.228753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3cb164d5ee432abc74bb00c7114d70)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.230789 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.266108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1014/2046] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:01 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:01.270092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.271677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:01.283954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838ba7-ffc3-42dc-81f1-3605153a0b1a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.289276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.290853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.290853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.290853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.291326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.293194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.302819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1015/2047] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:26:01.306495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.315449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d71a-24de-45dd-84b2-1e093cf6d7e1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.320639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.321336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.321613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.321878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.322601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.324193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.337373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1016/2048] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:26:01.341481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.352248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0da80-5970-4092-bf20-dae807fbba8a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.356924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.357802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.358084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.358366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] PATH_INFO: `/v3/projects/849d90b3fb594a1b9def185a4d7a94c3/users/f77a4aff6e424102bdf72e90a0940d03/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.372243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849d90b3fb594a1b9def185a4d7a94c3, user_id=f77a4aff6e424102bdf72e90a0940d03, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.374908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334ea85-1b51-43e1-880f-0f66efdad426 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.444603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3cb164d5ee432abc74bb00c7114d70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.445308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3cb164d5ee432abc74bb00c7114d70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.454412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3cb164d5ee432abc74bb00c7114d70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.462991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1017/2049] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:01 2022] PUT /identity/v3/projects/849d90b3fb594a1b9def185a4d7a94c3/users/f77a4aff6e424102bdf72e90a0940d03/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:01.475378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.475378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.475378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.501932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] MFA Rules not processed for user `f77a4aff6e424102bdf72e90a0940d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:01.503113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:01.534559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3cb164d5ee432abc74bb00c7114d70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.552561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3cb164d5ee432abc74bb00c7114d70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:01.559426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1033/2050] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:01 2022] DELETE /identity/v3/users/1b3cb164d5ee432abc74bb00c7114d70 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:01.566477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1018/2051] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:01.583666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.585274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:01.654708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707921cb-cf99-4d33-ac1c-de37d9def257 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:01.658645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:01.659292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:01.659574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:01.659999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:01.722526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:01.723948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a7b65-0c88-4312-81ad-0302bdbb9144 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:01.732987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1034/2052] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:01.970629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:01.972075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:02.041985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23990bf2-3d3e-4299-9298-8cfd4a30eb2a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.096787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.097687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.097951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.098223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] PATH_INFO: `/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.099390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5922f81b1f2c4ffcafc9193be5abafeb)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.101330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.224829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5922f81b1f2c4ffcafc9193be5abafeb', 'request_id': 'req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:02.230961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5922f81b1f2c4ffcafc9193be5abafeb', 'request_id': 'req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:02.236122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5922f81b1f2c4ffcafc9193be5abafeb', 'request_id': 'req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:02.317233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] The token cache is being invalidate because project 5922f81b1f2c4ffcafc9193be5abafeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:02.317564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:02.318177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e3ee7e21-bea5-42e7-b440-8320b09d0ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:02.319791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1019/2053] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:01 2022] DELETE /identity/v3/projects/5922f81b1f2c4ffcafc9193be5abafeb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:02.325528 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.325993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.326263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.352116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:02.353342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:02.416619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1035/2054] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:02.424543 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.425057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.425250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.443980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:02.445179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:02.453197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1020/2055] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:02.457405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.466855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f1a00-e6c3-4949-8121-71b93c183029 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.471645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.472321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.472627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.472893 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.473600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:26:02.473901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.475518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.487508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1036/2056] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:26:02.491362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.501524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df005c9-55a2-487a-9021-bf7a59dd3dc0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.506331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.506988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.507268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.508091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.508854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.510745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.604721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1021/2057] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:02 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:02.609033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.618943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708285-dbef-464b-ac0a-005fd3a4a84e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.673975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.674637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.674915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.675184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.675912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.677835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.740172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1037/2058] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:02 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:02.744997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.755400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611748b9-693c-40a3-8c25-fb8f74789e23 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.760734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.761407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.761686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.761966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.762686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.764283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.774872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1022/2059] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:02.778709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.788778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0b56-4b96-426a-ac87-fb71fe85c65b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.793761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.794469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.794749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.795019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.795734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.797324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c14188-9872-4ba0-8afe-ad6be4432dc7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.809469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1038/2060] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:02.813524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:02.823951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578378-d415-45b9-abdb-56911edb088c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:02.828597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:02.829495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.829770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.830039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] PATH_INFO: `/v3/projects/8f3bff7b2dab460a96fe0daf74723c8c/users/1bc10dd9204242fdb07953d1e61b33f3/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.843624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3bff7b2dab460a96fe0daf74723c8c, user_id=1bc10dd9204242fdb07953d1e61b33f3, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:02.846299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:02.893643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1023/2061] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:02 2022] PUT /identity/v3/projects/8f3bff7b2dab460a96fe0daf74723c8c/users/1bc10dd9204242fdb07953d1e61b33f3/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:02.904492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:02.904778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:02.905052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:02.936347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] MFA Rules not processed for user `1bc10dd9204242fdb07953d1e61b33f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:02.937571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:02.997652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1039/2062] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:03.002253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.068506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df062-0c9b-470e-93d8-fe43cf0db4dd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.073454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.074121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.074430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.074705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.075462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.077406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.208895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1024/2063] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:03 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:03.213086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.223679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce66b-928e-43e8-acac-b50803d659bb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.276823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.277479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.277763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.278037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.278711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.280724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.376194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1040/2064] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:03 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:03.377382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.387457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e0d23-b08e-40e7-9a6c-3ab75eebdd2d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.392505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.393345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.393626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.393903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.394649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.396237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.407324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1025/2065] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:03.417712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.427744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436510e3-ac2d-41f8-a47f-6adb3c896b5d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.433957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.434852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.435194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.435410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] PATH_INFO: `/v3/projects/7abd8e5225d7444eab70f16300aa9014/users/ae9b118f66774e5082261e1398c6afc1/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.451176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abd8e5225d7444eab70f16300aa9014, user_id=ae9b118f66774e5082261e1398c6afc1, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.453839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.512079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1041/2066] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:03 2022] PUT /identity/v3/projects/7abd8e5225d7444eab70f16300aa9014/users/ae9b118f66774e5082261e1398c6afc1/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:03.515887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.526043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe28a-28bc-4364-b751-b09dcc028045 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.587307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.587974 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.588256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.588564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.589279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.590888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7586a98-b7da-4b47-aa81-8583c4900dda admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.600842 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1026/2067] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:03.605417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.615798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a989d-51af-4c77-ae99-39d1eb4d4c39 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.620425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.621298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.621575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.621846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] PATH_INFO: `/v3/projects/7abd8e5225d7444eab70f16300aa9014/users/ae9b118f66774e5082261e1398c6afc1/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.623753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abd8e5225d7444eab70f16300aa9014, user_id=ae9b118f66774e5082261e1398c6afc1, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.626458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.636193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1042/2068] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:03 2022] PUT /identity/v3/projects/7abd8e5225d7444eab70f16300aa9014/users/ae9b118f66774e5082261e1398c6afc1/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:03.646396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.646713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.646989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.675552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] MFA Rules not processed for user `ae9b118f66774e5082261e1398c6afc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:03.677705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:03.748620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1027/2069] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:03.776289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:03.778720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:03.851098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e853-9189-4ec8-ad83-2e9582ad64c7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:03.858924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:03.859596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:03.859881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:03.860179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:03.870125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:03.872072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:03.882745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1043/2070] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:04.092787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:04.106460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e319d4-3fdc-4f87-af39-518a3ab84336 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:04.109999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:04.110631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:04.114351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:04.114351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:04.166815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:04.168547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717a287-37c0-4f3f-b42c-4c30c31ada19 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:04.178123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1028/2071] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:13.461589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:13.525561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed2ba4-3c07-47a0-abb4-66c90f6bbb50 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:13.530255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:13.531120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:13.531447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:13.531715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] PATH_INFO: `/v3/users/1bc10dd9204242fdb07953d1e61b33f3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:13.532926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc10dd9204242fdb07953d1e61b33f3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:13.534838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:13.775499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc10dd9204242fdb07953d1e61b33f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:13.776083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc10dd9204242fdb07953d1e61b33f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:13.782860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc10dd9204242fdb07953d1e61b33f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:13.888327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc10dd9204242fdb07953d1e61b33f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:13.901230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc10dd9204242fdb07953d1e61b33f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:13.907414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1044/2072] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:13 2022] DELETE /identity/v3/users/1bc10dd9204242fdb07953d1e61b33f3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:13.912057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:13.912585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:13.912682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:13.930026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:13.931217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:13.987735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1029/2073] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:13.998331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:14.000090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:14.058275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f068a1-19dc-4d01-8c6f-a140f0fae7ad admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:14.061767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:14.062406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:14.062686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:14.062958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:14.071816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:14.073339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:14.082710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1045/2074] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:14.518576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:14.520616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:14.535382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831f80-b87f-4eae-941c-137d43b7fce8 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:14.540947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:14.543671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:14.543671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:14.543671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] PATH_INFO: `/v3/projects/8f3bff7b2dab460a96fe0daf74723c8c` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:14.544634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3bff7b2dab460a96fe0daf74723c8c)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:14.546195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:14.681038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3bff7b2dab460a96fe0daf74723c8c', 'request_id': 'req-8cff2b79-1caf-4c5e-a316-126312670243'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:14.687080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3bff7b2dab460a96fe0daf74723c8c', 'request_id': 'req-8cff2b79-1caf-4c5e-a316-126312670243'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:14.692464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3bff7b2dab460a96fe0daf74723c8c', 'request_id': 'req-8cff2b79-1caf-4c5e-a316-126312670243'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:14.782987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] The token cache is being invalidate because project 8f3bff7b2dab460a96fe0daf74723c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:14.783299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:14.783911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:14.785516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1030/2075] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:14 2022] DELETE /identity/v3/projects/8f3bff7b2dab460a96fe0daf74723c8c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:14.789627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:14.799547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40cdb-5d9d-48ad-b2d7-31cb80f9cf76 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:14.854827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:14.855691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:14.855972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:14.856244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] PATH_INFO: `/v3/users/ae9b118f66774e5082261e1398c6afc1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:14.857456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9b118f66774e5082261e1398c6afc1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:14.859354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:15.079017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9b118f66774e5082261e1398c6afc1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.079697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9b118f66774e5082261e1398c6afc1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.087241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9b118f66774e5082261e1398c6afc1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.133965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9b118f66774e5082261e1398c6afc1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.146134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-022fca22-ea1b-4770-981a-1c288e8fc852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9b118f66774e5082261e1398c6afc1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.152315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1046/2076] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:14 2022] DELETE /identity/v3/users/ae9b118f66774e5082261e1398c6afc1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:15.626644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:15.628120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:15.641739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2b79-1caf-4c5e-a316-126312670243 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:15.698032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:15.698897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:15.699184 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:15.699451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] PATH_INFO: `/v3/projects/7abd8e5225d7444eab70f16300aa9014` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:15.700657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abd8e5225d7444eab70f16300aa9014)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:15.702557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:15.832166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abd8e5225d7444eab70f16300aa9014', 'request_id': 'req-445b314e-deab-4fb8-a160-1d489dc79c26'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.838845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abd8e5225d7444eab70f16300aa9014', 'request_id': 'req-445b314e-deab-4fb8-a160-1d489dc79c26'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.844715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abd8e5225d7444eab70f16300aa9014', 'request_id': 'req-445b314e-deab-4fb8-a160-1d489dc79c26'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.923054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] The token cache is being invalidate because project 7abd8e5225d7444eab70f16300aa9014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:15.923350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.923990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-445b314e-deab-4fb8-a160-1d489dc79c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:15.925841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1031/2077] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:15 2022] DELETE /identity/v3/projects/7abd8e5225d7444eab70f16300aa9014 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:15.930830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:15.931334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:15.931435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:15.949701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:15.950888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:16.012052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1047/2078] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:16.020872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.021161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.021440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.040737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:16.042587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:16.058918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1032/2079] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:16.063351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.073918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f239f-77c3-4179-bb24-c4a00bcec001 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.078608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.079306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.079582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.079847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.080596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:26:16.080896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.082491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.095339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1048/2080] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:26:16.100019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.109609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66856bc-9b0f-4e0e-9d5c-d7e2cf45374d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.114301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.114962 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.115238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.115508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.116215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.118731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.202775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1033/2081] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:16.204200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.214569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9bf8a-7412-4e38-b5a2-9d19ec448314 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.270184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.270774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.271051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.271320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.272097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.274145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.380039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1049/2082] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:16.386093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.396173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e08e5-4d23-428f-95c7-b59717129f71 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.401386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.402082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.402357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.402629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.403444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.405111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.416426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1034/2083] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:16.421061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.432672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5d7e-7834-4a28-9c39-61cb9a038e74 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.437966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.440119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.440119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.440119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.440119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.441592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57984546-a804-4fcd-bf2f-69d511a095bd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.455546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1050/2084] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:26:16.456737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.466675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac7ac-2bd1-429a-a98f-dd08cfb1631d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.471377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.474583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.474583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.474583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] PATH_INFO: `/v3/projects/ac9292d8a4234e87b5e7257a5eb25307/users/d0d11b0ce12a4c4eb715282c5b0313d5/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.489250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9292d8a4234e87b5e7257a5eb25307, user_id=d0d11b0ce12a4c4eb715282c5b0313d5, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.493745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.577041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1035/2085] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:16 2022] PUT /identity/v3/projects/ac9292d8a4234e87b5e7257a5eb25307/users/d0d11b0ce12a4c4eb715282c5b0313d5/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:16.589124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.589418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.589697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.620312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] MFA Rules not processed for user `d0d11b0ce12a4c4eb715282c5b0313d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:16.622480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:16.692330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1051/2086] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:16.696992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.761393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec647d-b2ce-495f-a3ce-4a318769f82c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.766021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.766790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.767069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.767340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.768016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.769932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:16.849344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1036/2087] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:16.853965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:16.864663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9da4f-36b3-468b-8aef-33ed960a8576 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:16.934700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:16.935391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:16.935674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:16.937180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:16.937180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:16.938579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.077439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1052/2088] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:16 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:17.081167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.091626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1659f-40f5-49c7-8be2-a9e4b8f6c9be admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.096245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.096975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.097252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.097561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.098276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.099919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.112467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1037/2089] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:17.116500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.126941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7702b-275b-45c1-a934-08183885b20f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.131782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.132657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.132938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.137682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.137682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.137682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19746e-28ac-4a20-9870-1ecf868c40e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.146663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1053/2090] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:17.151355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.161036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc653b9-295f-4036-9501-236ed58a0eb1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.166341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.167367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.167646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.167915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] PATH_INFO: `/v3/projects/14320ca829c748459e1c875b4f049fe3/users/b3a67027665a4da79da09168f0c0d954/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.182041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14320ca829c748459e1c875b4f049fe3, user_id=b3a67027665a4da79da09168f0c0d954, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.184776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.282436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1038/2091] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:17 2022] PUT /identity/v3/projects/14320ca829c748459e1c875b4f049fe3/users/b3a67027665a4da79da09168f0c0d954/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:17.292832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.293117 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.293389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.319075 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] MFA Rules not processed for user `b3a67027665a4da79da09168f0c0d954`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:17.320796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:17.382936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1054/2092] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:17.387397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.447421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e024b0-722f-4d24-934f-3d22c2c35715 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.452008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.452693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.452975 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.453246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.453937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.455813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.563229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1039/2093] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:17 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:17.567229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.578333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89baef5-9742-4fcb-914f-01617ac365ca None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.631853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.633092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.633377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.633648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.634336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.636274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.744564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1055/2094] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:17 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:17.748556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.759122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed821e24-4059-4a0f-b466-dcb218fc2ead admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.763799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.764484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.764765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.765039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.765755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.767334 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.778132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1040/2095] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:17.782014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.791702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190f2c-2444-4f7d-b84a-b2fe50fdb3f9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.800632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.800632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.800632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.800632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] PATH_INFO: `/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0/users/94e55a05d92c4e1a8bd9dd3624207233/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.812717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394dbd2145e472e9e3c8f0e6a5b4ea0, user_id=94e55a05d92c4e1a8bd9dd3624207233, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.815437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.910817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1056/2096] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:17 2022] PUT /identity/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0/users/94e55a05d92c4e1a8bd9dd3624207233/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:17.914643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:17.930109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0879a3-3eed-4a22-9c1d-46555b725052 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:17.984594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:17.985256 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:17.985536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:17.985807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:17.986521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:17.988094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6647ccc-c9e1-446c-979d-e92f3fe9df46 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:17.998118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1041/2097] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:18.002143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:18.013031 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c1b6-e022-47fd-8e6f-e52d80344a05 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:18.017306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:18.018163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:18.018444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:18.018711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] PATH_INFO: `/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0/users/94e55a05d92c4e1a8bd9dd3624207233/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:18.020670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394dbd2145e472e9e3c8f0e6a5b4ea0, user_id=94e55a05d92c4e1a8bd9dd3624207233, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:18.023267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:18.033063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1057/2098] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:18 2022] PUT /identity/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0/users/94e55a05d92c4e1a8bd9dd3624207233/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:18.045083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda27889-1596-43ab-a229-208127b2f338 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:18.045371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda27889-1596-43ab-a229-208127b2f338 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:18.045644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda27889-1596-43ab-a229-208127b2f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:18.071548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-fda27889-1596-43ab-a229-208127b2f338 None None] MFA Rules not processed for user `94e55a05d92c4e1a8bd9dd3624207233`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:18.072763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fda27889-1596-43ab-a229-208127b2f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:18.137977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1042/2099] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:18.157707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:18.159418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:18.216378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304c67-310e-4639-8486-faa4309fd8cc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:18.220054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:18.220735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:18.221015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:18.221286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:18.274436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:18.275847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:18.284340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1058/2100] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:21.343548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda27889-1596-43ab-a229-208127b2f338 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:21.345076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fda27889-1596-43ab-a229-208127b2f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:21.356812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda27889-1596-43ab-a229-208127b2f338 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:21.360383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:21.361057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:21.361336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:21.361608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:21.416177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:21.417896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:21.426729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1043/2101] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:22.966514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:22.974770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c62b6-c033-455f-b9c5-2235a35007de service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:22.978980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:22.979608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:22.979881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:22.980147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:22.988895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:22.990312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:22.999670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1059/2102] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:27.752200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:27.785152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:27.786969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:27.845499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e963d-272b-49e5-a906-8c2cff725b00 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:27.850262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:27.851273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:27.851551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:27.851823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] PATH_INFO: `/v3/users/d0d11b0ce12a4c4eb715282c5b0313d5` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:27.853043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d11b0ce12a4c4eb715282c5b0313d5)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:27.854998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:27.899441 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272965b7-7f83-4ca9-a753-ceb737bd32a8 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:27.904745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:27.905538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:27.905814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:27.906081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] PATH_INFO: `/v3/users/f77a4aff6e424102bdf72e90a0940d03` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:27.907246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77a4aff6e424102bdf72e90a0940d03)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:27.909155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:28.032971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d11b0ce12a4c4eb715282c5b0313d5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.033629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d11b0ce12a4c4eb715282c5b0313d5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.058829 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77a4aff6e424102bdf72e90a0940d03'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.059459 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77a4aff6e424102bdf72e90a0940d03'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.066019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77a4aff6e424102bdf72e90a0940d03'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.102991 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d11b0ce12a4c4eb715282c5b0313d5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.110007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d11b0ce12a4c4eb715282c5b0313d5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.121919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-91a26935-24ef-452e-bfec-33eb963d8de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d11b0ce12a4c4eb715282c5b0313d5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.127772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1044/2103] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:27 2022] DELETE /identity/v3/users/d0d11b0ce12a4c4eb715282c5b0313d5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:28.132001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.132292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.132604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.149628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:28.151327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.160252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77a4aff6e424102bdf72e90a0940d03'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.172812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d77cbf5-187c-42e1-9d85-c9a5cd7c9a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77a4aff6e424102bdf72e90a0940d03'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:28.178624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1060/2104] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:27 2022] DELETE /identity/v3/users/f77a4aff6e424102bdf72e90a0940d03 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:28.183069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.183353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.183628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.199561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:28.200774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.209016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1045/2105] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:28.219181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:28.220524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.257001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1061/2106] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:28.266340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:28.267682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.290322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d59ef-fd84-4b1e-afe2-680431e4660e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:28.321297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05b2b-b44d-4849-bd54-f6fcb3710e38 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:28.324987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:28.325625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.325906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.326177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.335660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:28.337590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:28.337742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:28.338734 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.339042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.339319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.348585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:28.350010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:28.350437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1062/2107] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:26:28.361667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1046/2108] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:26:28.874147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:28.874973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.902796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:28.902796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:28.927163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4dcf-ade7-4b5d-b9b8-bd2978064ed5 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:28.932886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:28.933664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce530c-d3a0-47b8-84e6-7d4ac25a09c1 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:28.933981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.934274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.934538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] PATH_INFO: `/v3/projects/849d90b3fb594a1b9def185a4d7a94c3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.935874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849d90b3fb594a1b9def185a4d7a94c3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:28.938131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:28.939517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:28.940423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:28.940776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:28.941119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] PATH_INFO: `/v3/projects/ac9292d8a4234e87b5e7257a5eb25307` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:28.942466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9292d8a4234e87b5e7257a5eb25307)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:28.944581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.059163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849d90b3fb594a1b9def185a4d7a94c3', 'request_id': 'req-c783d645-66f4-4ad8-91f7-ef9554ad50d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.082135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9292d8a4234e87b5e7257a5eb25307', 'request_id': 'req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.088154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9292d8a4234e87b5e7257a5eb25307', 'request_id': 'req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.093443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9292d8a4234e87b5e7257a5eb25307', 'request_id': 'req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.116342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849d90b3fb594a1b9def185a4d7a94c3', 'request_id': 'req-c783d645-66f4-4ad8-91f7-ef9554ad50d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.122613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849d90b3fb594a1b9def185a4d7a94c3', 'request_id': 'req-c783d645-66f4-4ad8-91f7-ef9554ad50d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.133371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] The token cache is being invalidate because project 849d90b3fb594a1b9def185a4d7a94c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:29.133656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.134295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c783d645-66f4-4ad8-91f7-ef9554ad50d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.136512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1063/2109] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:28 2022] DELETE /identity/v3/projects/849d90b3fb594a1b9def185a4d7a94c3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:29.140974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27624bf-9431-479a-901f-118b03ccc7ce None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.141257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27624bf-9431-479a-901f-118b03ccc7ce None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.141529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27624bf-9431-479a-901f-118b03ccc7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.178816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] The token cache is being invalidate because project ac9292d8a4234e87b5e7257a5eb25307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:29.179105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.179743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.181347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1047/2110] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:28 2022] DELETE /identity/v3/projects/ac9292d8a4234e87b5e7257a5eb25307 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:29.185838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.187195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.187684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a27624bf-9431-479a-901f-118b03ccc7ce None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:29.188878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a27624bf-9431-479a-901f-118b03ccc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.246168 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1064/2111] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:29.252608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b69a-2deb-45f1-bc3d-32b5c4b98e32 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.254276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.254387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.254589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.254863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.255220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.255497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.255771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] PATH_INFO: `/v3/users/b3a67027665a4da79da09168f0c0d954` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.256986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a67027665a4da79da09168f0c0d954)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.258906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.273131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:29.274318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.282609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1065/2112] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:29.287276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.296000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d75d13-6666-4b3e-a7d9-9534f9d0e20c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.300637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.301254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.301532 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.301805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.302503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:26:29.302811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.304389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.315962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1066/2113] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:26:29.319924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.328885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536bb9-d953-4e79-a375-f0bb3afd86c4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.335637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.336378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.336691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.341250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.341250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.341250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.425084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1067/2114] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:29 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:29.429091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.460825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a67027665a4da79da09168f0c0d954'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.461645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a67027665a4da79da09168f0c0d954'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.488141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec29ba-0695-4907-8672-3b65c23e3ee8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.492820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.493478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.493757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.494627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.495315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.497281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.532044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a67027665a4da79da09168f0c0d954'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.539189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a67027665a4da79da09168f0c0d954'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.551160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a67027665a4da79da09168f0c0d954'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:29.558188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1048/2115] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:29 2022] DELETE /identity/v3/users/b3a67027665a4da79da09168f0c0d954 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:29.599673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1068/2116] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:29 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:29.605239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.605239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.667039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fc173-9404-4fc7-9b5b-c229ad86f033 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.671803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.672490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.672767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.673040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.673751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.675388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.684887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1049/2117] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:29.689022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.698694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b78a6-5d7c-40b1-89a1-d69c2f0f2e11 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.703319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.703968 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.704244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.704544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.705254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.706828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651f97a-c112-4088-af4d-ebcd9d4167d4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.717406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1069/2118] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:29.721439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.733345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625153d5-6688-4662-ac84-ba9ad465b29f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:29.738030 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:29.739058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.739341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.739612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] PATH_INFO: `/v3/projects/6d07da3882154ea3841ed7e3f1d83ebf/users/4b13de0323cc420489faa8c5e81c0177/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.754985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d07da3882154ea3841ed7e3f1d83ebf, user_id=4b13de0323cc420489faa8c5e81c0177, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:29.758422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:29.833306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1050/2119] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:29 2022] PUT /identity/v3/projects/6d07da3882154ea3841ed7e3f1d83ebf/users/4b13de0323cc420489faa8c5e81c0177/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:29.835611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:29.835900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:29.836177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:29.874244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] MFA Rules not processed for user `4b13de0323cc420489faa8c5e81c0177`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:29.885538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.946924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.949200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:29.958997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1070/2120] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:29.970495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:29.974653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:30.017911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75095a7-d09d-4c79-b896-6b0b7370d425 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:30.023514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:30.024604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:30.031360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:30.031360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] PATH_INFO: `/v3/projects/14320ca829c748459e1c875b4f049fe3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:30.031360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14320ca829c748459e1c875b4f049fe3)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:30.031689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921376e-98a5-47ac-a888-d91fce6017e3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:30.031784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:30.034205 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:30.034899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:30.035236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:30.035544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:30.045362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:30.047076 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:30.056125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1071/2121] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:26:30.143502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14320ca829c748459e1c875b4f049fe3', 'request_id': 'req-6cb6fd1c-7592-4cab-8320-d984e2c2c448'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.149753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14320ca829c748459e1c875b4f049fe3', 'request_id': 'req-6cb6fd1c-7592-4cab-8320-d984e2c2c448'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.156259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14320ca829c748459e1c875b4f049fe3', 'request_id': 'req-6cb6fd1c-7592-4cab-8320-d984e2c2c448'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.245594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] The token cache is being invalidate because project 14320ca829c748459e1c875b4f049fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:30.245880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.246512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.248079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1051/2122] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:29 2022] DELETE /identity/v3/projects/14320ca829c748459e1c875b4f049fe3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:26:30.252115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:30.263378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fcbb-03dd-4c6f-b23c-49c62cc9cf1a service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:30.316704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:30.317556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:30.317833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:30.318101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] PATH_INFO: `/v3/users/94e55a05d92c4e1a8bd9dd3624207233` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:30.319273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e55a05d92c4e1a8bd9dd3624207233)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:30.321283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:30.506701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e55a05d92c4e1a8bd9dd3624207233'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.507376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e55a05d92c4e1a8bd9dd3624207233'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.515355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e55a05d92c4e1a8bd9dd3624207233'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.567471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e55a05d92c4e1a8bd9dd3624207233'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.579899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c16a528a-3536-4c9c-9e1b-a3941033339d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e55a05d92c4e1a8bd9dd3624207233'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:30.585725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1072/2123] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:26:30 2022] DELETE /identity/v3/users/94e55a05d92c4e1a8bd9dd3624207233 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:31.050036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.059808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:31.088741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6fd1c-7592-4cab-8320-d984e2c2c448 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.149300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.150731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.151020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.151293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] PATH_INFO: `/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.152524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a394dbd2145e472e9e3c8f0e6a5b4ea0)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.154426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.292737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a394dbd2145e472e9e3c8f0e6a5b4ea0', 'request_id': 'req-51555cf3-b836-48e3-842b-23f78fe56a48'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:31.298876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a394dbd2145e472e9e3c8f0e6a5b4ea0', 'request_id': 'req-51555cf3-b836-48e3-842b-23f78fe56a48'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:31.304110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a394dbd2145e472e9e3c8f0e6a5b4ea0', 'request_id': 'req-51555cf3-b836-48e3-842b-23f78fe56a48'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:31.373126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] The token cache is being invalidate because project a394dbd2145e472e9e3c8f0e6a5b4ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:26:31.373418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:31.374043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-51555cf3-b836-48e3-842b-23f78fe56a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:26:31.375898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1052/2124] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:26:31 2022] DELETE /identity/v3/projects/a394dbd2145e472e9e3c8f0e6a5b4ea0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:31.386191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.386731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.386824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.404271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:31.405587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:31.473880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1073/2125] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:31.481375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.481662 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.481938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.500878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:31.502122 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:31.511477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1053/2126] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:31.515788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.525794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2d85-86eb-4001-aea3-0163cbba874b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.530990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.531824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.531949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.532169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.532917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:26:31.533224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.534810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.546358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1074/2127] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:26:31.550730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.560705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b9c29-f7ec-48b4-9e1b-bf699b5551c0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.566763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.567418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.567694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.567984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.568701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.570591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a914-cf3a-43df-84a2-593bff245983 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.676674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1054/2128] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:26:31 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:26:31.680737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.691308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c5e8-0387-4f35-9658-d1791b8a6330 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.762449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.763204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.763574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.763914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.764809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.767170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.767621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.767913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.768189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.786144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] MFA Rules not processed for user `4b13de0323cc420489faa8c5e81c0177`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:31.787416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:31.840010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1055/2129] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:26:31.840570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1075/2130] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:26:31 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:26:31.844775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.855163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2744062-093c-4f71-a3b6-92f81d4ee08f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.859696 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.860352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.860659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.860929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.861762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.863408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.874793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1056/2131] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:26:31.878795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.889347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e6c1-5486-49c0-b603-fe80fb43230a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.895356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.896074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.896295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.896602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.897316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.898948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dce11e-fa05-4964-bbc3-4062b2427140 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:31.912281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1076/2132] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:26:31.913481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:31.923494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052d71-d788-47f6-b530-66fd11b04f8e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:31.928004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:31.928935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:31.929200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:31.929461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] PATH_INFO: `/v3/projects/dbf307be828e4477b78b3679ff34860d/users/9d5002ca0aab425c8281dc33a5d6225c/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:31.944079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf307be828e4477b78b3679ff34860d, user_id=9d5002ca0aab425c8281dc33a5d6225c, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:31.946746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:32.019915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1057/2133] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:26:31 2022] PUT /identity/v3/projects/dbf307be828e4477b78b3679ff34860d/users/9d5002ca0aab425c8281dc33a5d6225c/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:26:32.030897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adde1a-1954-4ef1-907b-3259edc1d629 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:32.031553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adde1a-1954-4ef1-907b-3259edc1d629 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:32.032010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adde1a-1954-4ef1-907b-3259edc1d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:32.060124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-84adde1a-1954-4ef1-907b-3259edc1d629 None None] MFA Rules not processed for user `9d5002ca0aab425c8281dc33a5d6225c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:32.061648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-84adde1a-1954-4ef1-907b-3259edc1d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:32.144728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1077/2134] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:26:32.156152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:26:32.158033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:32.225664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07072b-b49e-46ca-aa58-84ecff5d48ed admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:26:32.230101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:26:32.230931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:32.231216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:32.231563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:32.240181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:26:32.241648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc20c7c-7438-4b3d-bc8c-43c375a32672 service glance] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:26:32.250945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1058/2135] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:26:40.474160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd580cd-6294-4e30-9189-70e6f6b829b5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:26:40.474732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd580cd-6294-4e30-9189-70e6f6b829b5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:26:40.474732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd580cd-6294-4e30-9189-70e6f6b829b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:26:40.492242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8cd580cd-6294-4e30-9189-70e6f6b829b5 None None] MFA Rules not processed for user `8888d4dddb1f4329b0537148663b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:26:40.493491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8cd580cd-6294-4e30-9189-70e6f6b829b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:26:40.551403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1078/2136] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:05.820055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:05.820611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:05.820704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:05.838468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] MFA Rules not processed for user `2bf19c9a86344181a1cadd65c2d2dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:05.839719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:05.895062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1059/2137] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:07.073689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef63ae-2c9f-4b55-871b-eb3570437fa4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:07.074162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef63ae-2c9f-4b55-871b-eb3570437fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:07.074267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef63ae-2c9f-4b55-871b-eb3570437fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:07.101794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bdef63ae-2c9f-4b55-871b-eb3570437fa4 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:07.102967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bdef63ae-2c9f-4b55-871b-eb3570437fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:07.177999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1079/2138] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:07.260152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:07.261714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:07.360945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ebc45-f413-46fb-a990-4c55035dd869 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:07.367618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:07.368722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:07.369006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:07.369336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:07.379115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:07.381966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:07.390636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1060/2139] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:27:08.309739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838724-0db0-4c81-9ee7-9c8ef1f014a8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:08.310219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838724-0db0-4c81-9ee7-9c8ef1f014a8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:08.310349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838724-0db0-4c81-9ee7-9c8ef1f014a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:08.330293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d8838724-0db0-4c81-9ee7-9c8ef1f014a8 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:08.331507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d8838724-0db0-4c81-9ee7-9c8ef1f014a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:08.339551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1080/2140] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:08.353196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:08.366898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fc1d-1a07-4872-9961-c8eb592f19a6 service swift] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:08.379440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:08.380148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:08.380487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:08.380763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:08.394708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:08.396458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:08.405964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1061/2141] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:27:09.079504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488c8e-e79a-4f4d-a9e2-b05aa5015e89 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:09.079793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488c8e-e79a-4f4d-a9e2-b05aa5015e89 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:09.080067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488c8e-e79a-4f4d-a9e2-b05aa5015e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:09.098171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b0488c8e-e79a-4f4d-a9e2-b05aa5015e89 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:09.099356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b0488c8e-e79a-4f4d-a9e2-b05aa5015e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:09.106701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1081/2142] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:27:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:09.118614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:09.128887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562774e7-9032-4d18-b99c-b76ed42473f3 service swift] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:09.133906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:09.134530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:09.134806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:09.135074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:09.143388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:09.144977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:09.152639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1062/2143] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:27:10.231781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:10.232284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:10.232422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:10.249970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:10.251179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:10.258232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1082/2144] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:10.271359 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:10.282025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ba0-df3d-4058-9e66-2e02717a1d9a service swift] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:10.286895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:10.287514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:10.287791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:10.288059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:10.296028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:10.297613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305ce83-302b-4e77-90f3-7094f16f8a53 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:10.305325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1063/2145] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:27:12.837445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:12.838899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:12.901821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b93ff2-f680-4ddd-9084-2627fb012aa1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:12.906277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:12.907145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:12.907422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:12.907693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] PATH_INFO: `/v3/users/4b13de0323cc420489faa8c5e81c0177` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:12.908976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b13de0323cc420489faa8c5e81c0177)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:12.910885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:13.063342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b13de0323cc420489faa8c5e81c0177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.064544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b13de0323cc420489faa8c5e81c0177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.072255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b13de0323cc420489faa8c5e81c0177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.147906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b13de0323cc420489faa8c5e81c0177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.160101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b13de0323cc420489faa8c5e81c0177'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.166067 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1083/2146] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:27:12 2022] DELETE /identity/v3/users/4b13de0323cc420489faa8c5e81c0177 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:27:13.170839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:13.171300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:13.171418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:13.189934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:13.190967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:13.250246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1064/2147] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:27:13.260745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:13.265561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:13.341051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c275d86-0bc5-441c-8a28-0ebe5ab3d289 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:13.346355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:13.357452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:13.357452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:13.357452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:13.357452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:13.358705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:13.368781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1084/2148] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:13.769257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:13.771040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:13.791711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb914d-12ba-469c-9b5f-a338e2f42f67 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:13.804159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:13.805099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:13.805382 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:13.805656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] PATH_INFO: `/v3/projects/6d07da3882154ea3841ed7e3f1d83ebf` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:13.806841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d07da3882154ea3841ed7e3f1d83ebf)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:13.808851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:13.943909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d07da3882154ea3841ed7e3f1d83ebf', 'request_id': 'req-34be5ebc-0799-444f-9555-4c2c6571198f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.949973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d07da3882154ea3841ed7e3f1d83ebf', 'request_id': 'req-34be5ebc-0799-444f-9555-4c2c6571198f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:13.955944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d07da3882154ea3841ed7e3f1d83ebf', 'request_id': 'req-34be5ebc-0799-444f-9555-4c2c6571198f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:14.005640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] The token cache is being invalidate because project 6d07da3882154ea3841ed7e3f1d83ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:27:14.005927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:14.006545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-34be5ebc-0799-444f-9555-4c2c6571198f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:14.008156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1065/2149] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:27:13 2022] DELETE /identity/v3/projects/6d07da3882154ea3841ed7e3f1d83ebf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:27:18.286206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:18.288489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:18.309757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed489-9739-4c7f-8b63-3b98a9d1ee64 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:18.390901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:18.390901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:18.390901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:18.390901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] PATH_INFO: `/v3/users/9d5002ca0aab425c8281dc33a5d6225c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:18.392765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5002ca0aab425c8281dc33a5d6225c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:18.394792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:18.553643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5002ca0aab425c8281dc33a5d6225c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:18.554737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5002ca0aab425c8281dc33a5d6225c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:18.567742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5002ca0aab425c8281dc33a5d6225c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:18.617756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5002ca0aab425c8281dc33a5d6225c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:18.629715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8dbab0a2-367f-4311-ac62-92ef397336f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5002ca0aab425c8281dc33a5d6225c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:18.635934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1085/2150] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:27:18 2022] DELETE /identity/v3/users/9d5002ca0aab425c8281dc33a5d6225c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:27:18.640579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:18.641135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:18.641658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:18.668055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:18.669571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:18.687120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:18.687513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:18.687915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:18.738084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1066/2151] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:27:18.748301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:18.749751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:18.751899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:18.754348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:18.812503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f2c8-bd01-4b03-bde2-d3c92ccf5c30 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:18.816993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:18.817994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:18.818268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:18.819489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:18.832035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:18.832276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1086/2152] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:27:18.833631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:18.839584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:18.841175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:18.844742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1067/2153] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:18.958897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96851-be74-4fb5-a6aa-9ea55a77df2a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:18.964682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:18.965749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:18.966503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:18.967018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:18.978548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:18.979838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedf97b-2a98-4dba-ac70-94d55b1019a5 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:18.989554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1087/2154] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 12:27:19.723870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:19.725436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:19.762190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed193-a2b9-45ce-bc78-502238b55e4f service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:19.772154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:19.785246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:19.786042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:19.786659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] PATH_INFO: `/v3/projects/dbf307be828e4477b78b3679ff34860d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:19.788558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf307be828e4477b78b3679ff34860d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:19.790999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:19.918547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf307be828e4477b78b3679ff34860d', 'request_id': 'req-86c4005e-af1e-499d-9836-4949257dfbb1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:19.928054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf307be828e4477b78b3679ff34860d', 'request_id': 'req-86c4005e-af1e-499d-9836-4949257dfbb1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:19.937406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf307be828e4477b78b3679ff34860d', 'request_id': 'req-86c4005e-af1e-499d-9836-4949257dfbb1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:20.000403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] The token cache is being invalidate because project dbf307be828e4477b78b3679ff34860d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:27:20.000707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:20.001699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-86c4005e-af1e-499d-9836-4949257dfbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:27:20.003500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1068/2155] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:27:19 2022] DELETE /identity/v3/projects/dbf307be828e4477b78b3679ff34860d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:27:20.008197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.008747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.009012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.053634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:20.054903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:20.124686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1088/2156] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:20.132395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.132687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.133006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.155647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:20.156898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:20.167310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1069/2157] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:20.173597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:20.183735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56f01-bcbd-4071-8f1d-4791fd0ff2c8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:20.188941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:20.189797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.190120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.190409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.191133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:27:20.191442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:20.193078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:20.235179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1089/2158] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:27:20.241387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:20.283369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f560-bbba-4336-847f-d97e6312d917 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:20.302731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:20.304014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.307305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.307305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.307305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:20.308797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:20.652840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1070/2159] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:27:20 2022] POST /identity/v3/projects => generated 371 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:27:20.653709 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:20.676342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5842-ee2f-4e0a-88d9-09bbfa30a6fd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:20.817333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:20.823444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.823444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.823444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.823444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:20.823444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:20.897842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1090/2160] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:27:20 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:27:20.902025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:20.915071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5c9d-1eca-4030-8f09-60cc79154471 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:20.920455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:20.921135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.921415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.921832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.922703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:20.924992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:20.955506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1071/2161] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:27:20.956778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:20.969350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ed0-5386-42f7-b27c-d880b1a71abe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:20.974230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:20.974897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:20.975182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:20.975448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:20.976164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:20.977913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a5f9-8c24-4002-b0b9-dc3d64f37612 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:20.989576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1091/2162] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:27:20.995415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:21.006850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527273a-5793-4fd5-a8c9-e3cae4655e9f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:21.014493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:21.015871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:21.016159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:21.016443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] PATH_INFO: `/v3/projects/cfe9e07f034941009488167dde06eac4/users/e5b37675409042d8bbf38439c3549bd7/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:21.035677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe9e07f034941009488167dde06eac4, user_id=e5b37675409042d8bbf38439c3549bd7, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:21.040047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:21.118931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1072/2163] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:27:20 2022] PUT /identity/v3/projects/cfe9e07f034941009488167dde06eac4/users/e5b37675409042d8bbf38439c3549bd7/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:27:21.123701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ff87-65de-4187-8d07-270f75dcf0fc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:21.124163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ff87-65de-4187-8d07-270f75dcf0fc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:21.124163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ff87-65de-4187-8d07-270f75dcf0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:21.154124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9907ff87-65de-4187-8d07-270f75dcf0fc None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:21.155366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9907ff87-65de-4187-8d07-270f75dcf0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:21.241937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1092/2164] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:27:21.252107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:21.254409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:21.355575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf994-0b07-4c06-97e4-61c0c1791148 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:21.361354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:21.362050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:21.362314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:21.362586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:21.374639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:21.375469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:21.386616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1073/2165] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:27:29.123504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.124020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.124169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.165692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] MFA Rules not processed for user `e5b37675409042d8bbf38439c3549bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:29.167272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:29.257877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1093/2166] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:29.262350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.274120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839462e4-7ecc-4198-80c4-b23951031431 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.279021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.279914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.280288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.280669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.281436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.284239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.410058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1074/2167] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:27:29 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:27:29.411327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.424539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20938e6-caa0-47bf-95de-0b7c34bfc7fe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.495619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.496381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.496749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.497096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.497853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.500006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.607562 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1094/2168] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:27:29 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:27:29.611655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.624624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e126-3fb3-450d-af35-d4373e033e8d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.631055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.631971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.632352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.632683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.637027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.637027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.648593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1075/2169] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:27:29.652995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.672874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048461b-62ed-4451-9fde-a5eb9cbfbdc9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.678106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.679004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.679289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.679567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] PATH_INFO: `/v3/projects/4a8686850db14857b14e7034ef2c462a/users/9b8e5754acea4b6abe39c5c66b1b21a5/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.699158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8686850db14857b14e7034ef2c462a, user_id=9b8e5754acea4b6abe39c5c66b1b21a5, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.701855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.805761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1095/2170] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:27:29 2022] PUT /identity/v3/projects/4a8686850db14857b14e7034ef2c462a/users/9b8e5754acea4b6abe39c5c66b1b21a5/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:27:29.810041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.822247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e659e9-c25d-4ebd-9e9e-c503bdf57a1d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.903309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.904278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.904940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.905443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.906053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.907730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c66138-ae4e-410a-a108-e1969bf095b3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.919196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1076/2171] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:27:29.923518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:29.934765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f26755-af8b-4b84-8207-723417a998cc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:29.941304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:29.942437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:29.942728 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:29.943125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] PATH_INFO: `/v3/projects/4a8686850db14857b14e7034ef2c462a/users/9b8e5754acea4b6abe39c5c66b1b21a5/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:29.947148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8686850db14857b14e7034ef2c462a, user_id=9b8e5754acea4b6abe39c5c66b1b21a5, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:29.950679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:29.961848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1096/2172] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:27:29 2022] PUT /identity/v3/projects/4a8686850db14857b14e7034ef2c462a/users/9b8e5754acea4b6abe39c5c66b1b21a5/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:27:32.359650 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652d91-e250-4777-ae62-e564eb7bec18 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:32.360251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652d91-e250-4777-ae62-e564eb7bec18 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:32.360251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652d91-e250-4777-ae62-e564eb7bec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:32.394712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ff652d91-e250-4777-ae62-e564eb7bec18 None None] MFA Rules not processed for user `93e76b0776bd4b588b23327203229df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:32.396194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ff652d91-e250-4777-ae62-e564eb7bec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:32.474019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1077/2173] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:38.261904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:38.265208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:38.383839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5e97-d2d7-430f-b751-ebd4b482e92a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:38.391431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:38.392215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:38.392548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:38.393753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:38.395042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:38.414295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:38.417372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:38.437828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1097/2174] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:39.642423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846871d-e156-485f-b7dc-52cbbdf69fe0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:39.643288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846871d-e156-485f-b7dc-52cbbdf69fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:39.643647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846871d-e156-485f-b7dc-52cbbdf69fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:39.673818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8846871d-e156-485f-b7dc-52cbbdf69fe0 None None] MFA Rules not processed for user `9b8e5754acea4b6abe39c5c66b1b21a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:39.675190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8846871d-e156-485f-b7dc-52cbbdf69fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:39.742572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1078/2175] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:39.753519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:39.754932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:39.857313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbeab-3552-4e0c-8720-59c1df11ed9d service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:39.866000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:39.867261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:39.867611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:39.867964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:39.945323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:39.948047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf808b9-e35a-40ce-a529-1e9e27ddfb71 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:39.959066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1098/2176] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:41.632587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:41.633507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:41.633788 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:41.635171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1079/2177] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:27:41.641605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731393b-0d40-4524-a729-a2b4127cff30 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:41.642154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731393b-0d40-4524-a729-a2b4127cff30 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:41.642154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731393b-0d40-4524-a729-a2b4127cff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:41.692949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9731393b-0d40-4524-a729-a2b4127cff30 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:41.694698 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9731393b-0d40-4524-a729-a2b4127cff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:41.711420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1099/2178] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:41.725784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:41.727624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:41.843054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afe1ce-e909-4320-92a3-307567dd6621 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:41.849329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:41.849329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:41.849329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:41.849872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:41.861951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:41.863415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2af6a-2a55-4742-9b85-9793d2c82bb6 service glance] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:41.876150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1080/2179] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:42.174827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.174827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.175204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.178165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1100/2180] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:27:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:27:42.186392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0489-e0d0-4c18-94a0-b8cda451e4c0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.186762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0489-e0d0-4c18-94a0-b8cda451e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.187120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0489-e0d0-4c18-94a0-b8cda451e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.209697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8dbd0489-e0d0-4c18-94a0-b8cda451e4c0 None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:42.211098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8dbd0489-e0d0-4c18-94a0-b8cda451e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:42.308447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1081/2181] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:42.336155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:42.344865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:42.412570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986fa8-3a25-43f6-a9af-72c3806f9e50 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:42.420630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:42.421475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.422198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.423013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.437543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:42.440512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35882f-84d6-43c6-826d-0005c9fb5d22 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:42.451345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1101/2182] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:42.637417 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94698-3a37-48cf-a6cf-301f60430c4c None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.637884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94698-3a37-48cf-a6cf-301f60430c4c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.639115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94698-3a37-48cf-a6cf-301f60430c4c None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.640611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1082/2183] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:27:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:27:42.647271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1fef7-e046-4523-84de-635d74e3ed18 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.647799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1fef7-e046-4523-84de-635d74e3ed18 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.647982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1fef7-e046-4523-84de-635d74e3ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.677477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7be1fef7-e046-4523-84de-635d74e3ed18 None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:42.678937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7be1fef7-e046-4523-84de-635d74e3ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:42.690650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1102/2184] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:27:42.705376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94698-3a37-48cf-a6cf-301f60430c4c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:42.717949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94698-3a37-48cf-a6cf-301f60430c4c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:42.722104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:42.723000 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:42.723457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:42.725038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:42.736439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:42.738162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51aa77-f2c0-4518-863c-1fde0d450d8e service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:42.761271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1083/2185] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:27:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:27:43.373688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:43.374040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:43.374483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:43.395492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] MFA Rules not processed for user `e5b37675409042d8bbf38439c3549bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:43.396988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:43.406016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1103/2186] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:27:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:47.830295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6666e-15d7-4967-82dd-72c3c1949861 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:47.830295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6666e-15d7-4967-82dd-72c3c1949861 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:47.830295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6666e-15d7-4967-82dd-72c3c1949861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:47.846423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-70a6666e-15d7-4967-82dd-72c3c1949861 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:27:47.851366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-70a6666e-15d7-4967-82dd-72c3c1949861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:47.902890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1084/2187] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:27:47.915611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:27:47.916981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:27:47.985051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478eef3-27dc-4458-ae5e-295797c915e0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:27:47.990200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:27:47.991012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:27:47.991127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:27:47.991387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:27:48.001657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:27:48.003479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:27:48.014932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1104/2188] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:27:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:28:16.199317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b332b-458e-4807-9a13-bbad75203927 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:28:16.199882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b332b-458e-4807-9a13-bbad75203927 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:28:16.199882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b332b-458e-4807-9a13-bbad75203927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:28:16.220179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b03b332b-458e-4807-9a13-bbad75203927 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:28:16.221964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b03b332b-458e-4807-9a13-bbad75203927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:28:16.229146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1085/2189] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:28:16.250151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:28:16.260800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e876-c889-4343-8a0e-d9d4493ac0f5 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:28:16.265695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:28:16.266316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:28:16.266593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:28:16.266860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:28:16.275275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:28:16.276881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:28:16.285425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1105/2190] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:28:39.264602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146200e-7995-4ae5-a1de-8bffa72f7041 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:28:39.265029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146200e-7995-4ae5-a1de-8bffa72f7041 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:28:39.265270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146200e-7995-4ae5-a1de-8bffa72f7041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:28:39.282668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a146200e-7995-4ae5-a1de-8bffa72f7041 None None] MFA Rules not processed for user `8888d4dddb1f4329b0537148663b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:28:39.284927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a146200e-7995-4ae5-a1de-8bffa72f7041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:28:39.357765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1086/2191] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:28:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:28:42.193382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:28:42.204461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c09c-3cdd-4db9-b94b-5b00ec76f36b service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:28:42.208226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:28:42.209438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:28:42.209438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:28:42.209638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:28:42.218714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:28:42.220135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:28:42.230545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1106/2192] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:28:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:28:54.345202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:28:54.345682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:28:54.347738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:28:54.363199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] MFA Rules not processed for user `2bf19c9a86344181a1cadd65c2d2dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:28:54.364395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:28:54.418561 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1087/2193] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:28:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:10.858334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:10.860825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:10.949994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c17d1-d415-4b8b-955c-6c75f5285b4f service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:10.961959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:10.963246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:10.963754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:10.964243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] PATH_INFO: `/v3/users/93e76b0776bd4b588b23327203229df8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:10.965913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e76b0776bd4b588b23327203229df8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:10.968263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:11.218167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e76b0776bd4b588b23327203229df8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.219226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e76b0776bd4b588b23327203229df8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.226905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e76b0776bd4b588b23327203229df8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.309519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e76b0776bd4b588b23327203229df8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.325759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6222d57c-dfa6-4a35-89e8-7c3f6b0d5066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e76b0776bd4b588b23327203229df8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.336604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1107/2194] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:29:10 2022] DELETE /identity/v3/users/93e76b0776bd4b588b23327203229df8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:29:11.615760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:11.627552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f680f4-7e5a-4f50-99fa-ab114ebeae56 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:11.769819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:11.770624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:11.770900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:11.771173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] PATH_INFO: `/v3/projects/351fe17327d14798b1eb1880341e6937` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:11.772349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351fe17327d14798b1eb1880341e6937)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:11.774282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:11.886194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351fe17327d14798b1eb1880341e6937', 'request_id': 'req-5f9083dc-0877-4fb3-8434-92acd647a902'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.892124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351fe17327d14798b1eb1880341e6937', 'request_id': 'req-5f9083dc-0877-4fb3-8434-92acd647a902'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.897510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351fe17327d14798b1eb1880341e6937', 'request_id': 'req-5f9083dc-0877-4fb3-8434-92acd647a902'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.982907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] The token cache is being invalidate because project 351fe17327d14798b1eb1880341e6937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:29:11.983192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.983810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-5f9083dc-0877-4fb3-8434-92acd647a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:11.985395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1088/2195] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:29:11 2022] DELETE /identity/v3/projects/351fe17327d14798b1eb1880341e6937 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:11.992073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:11.992073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:11.992073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.008588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:12.009772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:12.065878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1108/2196] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:12.073420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.073709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.073983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.092635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:12.093823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:12.102171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1089/2197] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:12.106174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.115758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7b220-d2b4-415b-804f-246e18babacf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.120206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.120870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.121148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.121436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.122128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:29:12.122530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.124120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.135415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1109/2198] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:29:12.143824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.153429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222e032-a5fc-4008-b645-98e60516aefe None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.158138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.158797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.159077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.159405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.160112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.162045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.264886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1090/2199] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:29:12 2022] POST /identity/v3/projects => generated 397 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:29:12.268760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.279037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98edb-82cb-4c5d-986a-ff1a768138b2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.333007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.333596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.333880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.334162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.334853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.337438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.423974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1110/2200] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:29:12 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:29:12.428069 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.438207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa36c56-19bc-4883-8bbc-1de91da02b94 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.442759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.443416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.443697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.443972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.444740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.446820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.457129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1091/2201] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:29:12.461996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.471764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e22bd-991c-4b7e-800f-857160378ab8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.476565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.477234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.482423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.482423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.482423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.482423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9066fe8-bff2-4273-80f9-7fdf76bb3c21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.490084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1111/2202] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:29:12.494243 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.504230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70fcf-c4ab-4a6b-9c7f-c9404267b6d5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.509620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.510533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.510793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.511067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] PATH_INFO: `/v3/projects/7e4f107ef493488c977650b188b2623b/users/02a0980c5dcc4ca1bd4fa8b3c798c415/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.527128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4f107ef493488c977650b188b2623b, user_id=02a0980c5dcc4ca1bd4fa8b3c798c415, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.529860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.628171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1092/2203] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:29:12 2022] PUT /identity/v3/projects/7e4f107ef493488c977650b188b2623b/users/02a0980c5dcc4ca1bd4fa8b3c798c415/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:12.638645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.638931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.639206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.665408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] MFA Rules not processed for user `02a0980c5dcc4ca1bd4fa8b3c798c415`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:12.666609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:12.734482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1112/2204] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:12.746562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:12.748610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:12.827469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c3b0-4b72-49bc-beaa-b797a7ade469 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:12.831229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:12.831876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:12.832159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:12.832465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:12.840857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:12.842277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa122-a63e-489b-9379-18341ffe71f2 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:12.850817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1093/2205] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:21.627520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:21.698027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a6e10-60ce-451f-b8d6-741f56daf2c3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:21.702640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:21.703514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:21.703803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:21.704073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] PATH_INFO: `/v3/users/02a0980c5dcc4ca1bd4fa8b3c798c415` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:21.705394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a0980c5dcc4ca1bd4fa8b3c798c415)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:21.707306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:21.886209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a0980c5dcc4ca1bd4fa8b3c798c415'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:21.887144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a0980c5dcc4ca1bd4fa8b3c798c415'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:21.896634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a0980c5dcc4ca1bd4fa8b3c798c415'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:21.966413 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a0980c5dcc4ca1bd4fa8b3c798c415'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:21.980300 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a0980c5dcc4ca1bd4fa8b3c798c415'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:21.986262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1113/2206] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:29:21 2022] DELETE /identity/v3/users/02a0980c5dcc4ca1bd4fa8b3c798c415 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:22.003779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534f78-b4df-41cd-a3b2-fc24f86d64f7 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.004343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534f78-b4df-41cd-a3b2-fc24f86d64f7 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.004585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534f78-b4df-41cd-a3b2-fc24f86d64f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.022874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-64534f78-b4df-41cd-a3b2-fc24f86d64f7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:22.024085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-64534f78-b4df-41cd-a3b2-fc24f86d64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.085404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1094/2207] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:22.095508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:22.100100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.159266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbaee3-a560-4dc5-ae89-1adf379eeec2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:22.163108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:22.163778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.164058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.164334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.174112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:22.175552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:22.186291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1114/2208] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:22.385768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe0db-dbf3-413b-8a09-bb409759be1e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.385969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe0db-dbf3-413b-8a09-bb409759be1e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.386276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fe0db-dbf3-413b-8a09-bb409759be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.403770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8f3fe0db-dbf3-413b-8a09-bb409759be1e None None] MFA Rules not processed for user `6872824c64934fbba7a3863f30f2fde0`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:22.405106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8f3fe0db-dbf3-413b-8a09-bb409759be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.459550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1095/2209] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:22.602882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:22.604409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.619737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf77-de5b-4fe8-b8a0-e4efd37b4f4b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:22.624920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:22.625785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.626103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.626313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] PATH_INFO: `/v3/projects/7e4f107ef493488c977650b188b2623b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.627569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4f107ef493488c977650b188b2623b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:22.629633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:22.759938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4f107ef493488c977650b188b2623b', 'request_id': 'req-f55386d0-977c-4242-8d3a-4ca3b55c5a76'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:22.812316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4f107ef493488c977650b188b2623b', 'request_id': 'req-f55386d0-977c-4242-8d3a-4ca3b55c5a76'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:22.820763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4f107ef493488c977650b188b2623b', 'request_id': 'req-f55386d0-977c-4242-8d3a-4ca3b55c5a76'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:22.833156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] The token cache is being invalidate because project 7e4f107ef493488c977650b188b2623b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:29:22.833466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:22.834130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f55386d0-977c-4242-8d3a-4ca3b55c5a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:29:22.835885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1115/2210] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:29:22 2022] DELETE /identity/v3/projects/7e4f107ef493488c977650b188b2623b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:22.841114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.841402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.841678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.861299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:22.862632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.933163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1096/2211] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:22.942087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.942375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.942656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.962887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:22.964017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:22.975167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1116/2212] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:29:22.979953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:22.989345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7a5be-dd13-427b-9f1c-a99943cba37d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:22.994710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:22.995304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:22.995583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:22.995854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:22.996603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:29:22.996905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:22.998486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.011118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1097/2213] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:29:23.015388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.025282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2ae41-fc6f-46a1-9d4d-2f2c266a33b2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.030881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.031543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.031827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.032097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.032820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.034711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.143974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1117/2214] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:29:23 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:29:23.144669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.155560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b58cec-3a20-465f-93b6-aa191e3a6c16 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.216038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.216745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.217029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.217306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.217994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.219967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.320459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1098/2215] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:29:23 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:29:23.325187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.335238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfe84-e2a3-45be-ac24-1b37e7dbc8a4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.340762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.341429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.341734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.341990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.342722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.344317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.355179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1118/2216] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:29:23.359226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.369230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e7dc-8e09-4c77-95f0-8605d7353e26 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.373998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.374641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.374916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.375186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.375896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.377647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69276baf-1114-427b-b1dd-f21e1f861dec admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.388316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1099/2217] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:29:23.392212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.402623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a672b-cb29-438e-823c-c1bacbed4484 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.407633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.408551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.408892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.409254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] PATH_INFO: `/v3/projects/f7295e7b624c421095f925d2875434e6/users/4b821add1bb64267813f3b3a1eba02ae/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.424203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7295e7b624c421095f925d2875434e6, user_id=4b821add1bb64267813f3b3a1eba02ae, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.426909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.533091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1119/2218] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:29:23 2022] PUT /identity/v3/projects/f7295e7b624c421095f925d2875434e6/users/4b821add1bb64267813f3b3a1eba02ae/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:23.538236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83ac0-c25a-49c6-9ecd-b509c108631e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.538512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83ac0-c25a-49c6-9ecd-b509c108631e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.538792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83ac0-c25a-49c6-9ecd-b509c108631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.557603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-dab83ac0-c25a-49c6-9ecd-b509c108631e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:23.558789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dab83ac0-c25a-49c6-9ecd-b509c108631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:23.616494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1100/2219] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:29:23.626519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:23.628240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:23.685148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8a83-ae1c-4508-ac57-b47c2eb1d30e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:23.689019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:23.689662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:23.689938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:23.690212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:23.699808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:23.701248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:23.710491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1120/2220] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:29.803386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:29.804342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:29.804849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:29.838186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] MFA Rules not processed for user `4b821add1bb64267813f3b3a1eba02ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:29.839373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:29.909272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1101/2221] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:29.913775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:29.924566 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa41d78-cd0c-434d-86b7-c9f6aaca7cf4 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:29.929432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:29.930098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:29.930419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:29.930702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:29.931385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:29.936480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.029587 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1121/2222] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:29:30.030775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.042048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9768-f986-460d-9661-41d28bac1d6d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.100469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.101404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.101766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.102182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.102940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.105111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.155860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.157591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:30.188789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1102/2223] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:29:30 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:29:30.193203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.204107 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61ff30-6a8d-46c5-9377-cb1e0f20eacc admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.209193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.210294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.210447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.210899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.212384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.214143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.222606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34610cd-f8cb-4df4-9c7a-921bbd003620 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.228271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1103/2224] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:29:30.228734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.228734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.228734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.228734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.229875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.230010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:30.241552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5908c-ec24-4328-8fb3-08e3f38f7990 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.246740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.247904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.248477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.248856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] PATH_INFO: `/v3/projects/736d95a987d5459594dd5b1aea58a612/users/3f10909568ae4541bbd40490001c36ac/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.266575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736d95a987d5459594dd5b1aea58a612, user_id=3f10909568ae4541bbd40490001c36ac, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.269471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.319558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.322149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.322452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1104/2225] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:29:30 2022] PUT /identity/v3/projects/736d95a987d5459594dd5b1aea58a612/users/3f10909568ae4541bbd40490001c36ac/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:29:30.326233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.362378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1122/2226] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:29:30.436737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762482c-e425-45a2-85c9-d4b4e1100272 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.442064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.443380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.443786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.444176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.445073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.447680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.459993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1105/2227] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:29:30.466201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:30.476802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992f0b-6cc0-44c2-b2f5-afff4da5119c service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:30.481499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:30.482410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:30.482692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:30.482972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] PATH_INFO: `/v3/projects/736d95a987d5459594dd5b1aea58a612/users/3f10909568ae4541bbd40490001c36ac/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:30.485025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736d95a987d5459594dd5b1aea58a612, user_id=3f10909568ae4541bbd40490001c36ac, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:30.487677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8ce06-24b1-40bf-9cd4-fc175ba7a258 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:30.504423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1123/2228] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:29:30 2022] PUT /identity/v3/projects/736d95a987d5459594dd5b1aea58a612/users/3f10909568ae4541bbd40490001c36ac/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:29:34.089886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:34.150978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa528-21f2-42d5-9565-05d10516f72a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:34.240464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:34.241705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:34.242268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:34.243230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:34.245325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:34.339103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:34.340595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:34.357993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1106/2229] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:29:37.144971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ad6d-e7a2-4b28-937a-e971525e3744 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:37.145493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ad6d-e7a2-4b28-937a-e971525e3744 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:37.145878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ad6d-e7a2-4b28-937a-e971525e3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:37.206642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0d46ad6d-e7a2-4b28-937a-e971525e3744 None None] MFA Rules not processed for user `3f10909568ae4541bbd40490001c36ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:37.208096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0d46ad6d-e7a2-4b28-937a-e971525e3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:37.363937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1124/2230] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:37.373387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:37.375292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:37.453228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872aff-4385-41bd-b92f-0569659eb266 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:37.457293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:37.457953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:37.458230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:37.458501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:37.524952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:37.526651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:37.536913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1107/2231] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:37.805851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:37.806139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:37.806412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:37.829889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:37.831593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:37.908277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1125/2232] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:38.046763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:38.048383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:38.128252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f28f4-d77a-4633-ac0a-58def0f08ade service glance] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:38.133811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:38.134468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:38.134745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:38.135017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:38.145467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:38.147284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b39f-0f46-4f5e-85fa-913314f4608f service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:38.157197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1108/2233] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:29:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:29:40.843418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:40.845437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:40.872143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6a16-ac5e-43fc-9c5e-38f112ca4369 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:40.879263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:40.879978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:40.880262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:40.880602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:40.882633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:40.962477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:40.964184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:40.991971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1126/2234] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:49.831763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44469f0-91ae-417b-947b-be2839437807 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:49.832321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44469f0-91ae-417b-947b-be2839437807 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:49.832321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44469f0-91ae-417b-947b-be2839437807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:49.850556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e44469f0-91ae-417b-947b-be2839437807 None None] MFA Rules not processed for user `4b821add1bb64267813f3b3a1eba02ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:49.851907 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e44469f0-91ae-417b-947b-be2839437807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:49.859322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1109/2235] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:50.104583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:50.113633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443729e-90c9-409f-ad99-86766acdbee9 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:50.117158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:50.118336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:50.118617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:50.118892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:50.120675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:50.129768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:50.131169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:50.139420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1127/2236] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:50.565624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44469f0-91ae-417b-947b-be2839437807 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:50.569383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e44469f0-91ae-417b-947b-be2839437807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:50.647874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44469f0-91ae-417b-947b-be2839437807 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:50.653384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:50.654047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:50.654329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:50.654604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:50.656350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:50.668019 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:50.670049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:50.679889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1110/2237] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:54.197116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:54.198509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:54.214631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951a661-d4ed-40be-af82-5ccb508ebd9b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:54.220082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:54.220738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:54.221015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:54.221286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:54.222967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:54.278822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:54.280409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600ac9-c87a-4a84-ba1d-43346ca8b427 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:54.289577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1128/2238] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:29:55.399117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:55.401187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:55.457540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8ec66-55a9-4866-841c-63d8e10a3650 service placement] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:55.461208 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:55.461836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:55.462113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:55.462430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:55.464915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:55.524858 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:55.527226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:55.537231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1111/2239] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:58.805053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:58.805610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:58.805610 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:58.843675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:29:58.844951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:58.869618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:58.876761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1129/2240] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:29:58.893040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1056-6214-4e02-a1c9-04eadd0aaacf service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:58.906934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:58.907177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:58.907454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:58.907728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:58.935675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:58.945155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:58.960020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1112/2241] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 12:29:59.079692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:59.091621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53bb81-b8a2-4c3a-8506-6c67043efd50 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:59.095680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:59.096325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:59.096677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:59.096950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:59.098776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:59.111113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:59.112674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:59.121255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1130/2242] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:29:59.794689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:29:59.828281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3395-4761-49a9-8486-93e2b1452bb2 service swift] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:29:59.839409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:29:59.840081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:29:59.840390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:29:59.840658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:29:59.846340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:29:59.886890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:29:59.890944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:29:59.930681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1113/2243] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:29:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:00.068604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:00.090691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b66-81c4-41ea-b19a-fcd48a9bfa2f service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:00.099059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:00.099941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:00.100424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:00.100689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:00.107972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:00.273364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:00.278807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:00.293251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1131/2244] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:06.340541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:06.342538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:06.358285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba2e03-3dd5-4a11-8368-89bc20ab75bd service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:06.363434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:06.364694 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:06.365187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:06.365660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] PATH_INFO: `/v3/users/8888d4dddb1f4329b0537148663b9b91` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:06.367263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8888d4dddb1f4329b0537148663b9b91)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:06.372434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:06.571740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8888d4dddb1f4329b0537148663b9b91'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:06.572535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8888d4dddb1f4329b0537148663b9b91'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:06.646421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8888d4dddb1f4329b0537148663b9b91'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:06.654387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8888d4dddb1f4329b0537148663b9b91'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:06.667329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b12bf373-f86b-4f14-9975-c52383574a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8888d4dddb1f4329b0537148663b9b91'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:06.674278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1114/2245] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:06 2022] DELETE /identity/v3/users/8888d4dddb1f4329b0537148663b9b91 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:06.951377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:06.961359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286849ed-8a62-45fa-b271-7fd63a02f70a service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.051899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.052891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.053645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.053989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] PATH_INFO: `/v3/projects/2ca893e56e3d4ee1b549cec12041c952` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.055542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca893e56e3d4ee1b549cec12041c952)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.058158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.179592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca893e56e3d4ee1b549cec12041c952', 'request_id': 'req-3b777d1a-3a12-468e-80f6-03b51ebf8f10'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:07.268908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca893e56e3d4ee1b549cec12041c952', 'request_id': 'req-3b777d1a-3a12-468e-80f6-03b51ebf8f10'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:07.274925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca893e56e3d4ee1b549cec12041c952', 'request_id': 'req-3b777d1a-3a12-468e-80f6-03b51ebf8f10'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:07.287074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] The token cache is being invalidate because project 2ca893e56e3d4ee1b549cec12041c952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:07.287363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:07.288220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b777d1a-3a12-468e-80f6-03b51ebf8f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:07.290267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1132/2246] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:06 2022] DELETE /identity/v3/projects/2ca893e56e3d4ee1b549cec12041c952 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:07.296389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.301329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.301329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.348325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:07.360202 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:07.436225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1115/2247] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:07.444301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.444966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.445409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.465858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:07.467070 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:07.479744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1133/2248] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:07.481063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.491046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d274687-f543-4015-821d-075886ab1eb8 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.497301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.497923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.498204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.498482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.499218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:07.499535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.501166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.516549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1116/2249] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:30:07.518862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.529797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a87a6-7992-4642-9dd9-cb6d91b7bf68 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.535396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.536171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.536579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.536890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.537589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.539531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.621052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1134/2250] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:07 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:07.625519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.635908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888764-5768-4529-9550-07e049051b74 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.699228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.699982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.700343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.700709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.701467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.703448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.789394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1117/2251] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:07 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:07.794729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.810341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e3372-7b26-447c-9e92-e33e7dda6879 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.815068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.817425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.817425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.817425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.817425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.818495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.828541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1135/2252] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:07.832699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.844949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af8e19-2f8c-4a89-a97e-9483e1086dee admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.849712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.850380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.850656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.850961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.851685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.853317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce999e-49b3-44d0-8a28-7ee612381095 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.864447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1118/2253] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:07.868656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:07.878791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25264c1-f20c-4c2c-b25b-20ef304fdfbb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:07.886655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:07.886655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.886655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.886655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] PATH_INFO: `/v3/projects/605855a55e864b52ba9fe66eff1c9402/users/487a2a21b23345feb341bd018ec34147/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.899358 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] RBAC: Authorizing `identity:create_grant(project_id=605855a55e864b52ba9fe66eff1c9402, user_id=487a2a21b23345feb341bd018ec34147, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:07.902583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:07.949260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1136/2254] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:07 2022] PUT /identity/v3/projects/605855a55e864b52ba9fe66eff1c9402/users/487a2a21b23345feb341bd018ec34147/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:07.961166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:07.961452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:07.961736 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:07.988321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] MFA Rules not processed for user `487a2a21b23345feb341bd018ec34147`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:07.989595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:08.050921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1119/2255] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:08.055211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.114453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1d65-861c-4a28-b7fc-a6573bda65de admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.119119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.119766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.120040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.120307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.121014 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.122870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.213864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1137/2256] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:08 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:08.217399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.227864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8edfbb-0e8e-42a5-ad11-a7243c613d21 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.280806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.281505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.281779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.282047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.282740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.284697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.389711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1120/2257] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:08 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:08.393819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.405181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31be4c5-3d1f-4141-b378-ffd050cd2a06 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.410105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.410797 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.411077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.411376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.412130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.413752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.424729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1138/2258] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:08.430418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.444909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e5660-17bb-4cb7-b7b0-6a873a7c82f0 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.451174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.452801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.453399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.456023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] PATH_INFO: `/v3/projects/b717220d6e6249ff98e5fb1555cad9ec/users/f0065ed595f8494da203278171cbcabe/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.470184 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b717220d6e6249ff98e5fb1555cad9ec, user_id=f0065ed595f8494da203278171cbcabe, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.473225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.552602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1121/2259] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:08 2022] PUT /identity/v3/projects/b717220d6e6249ff98e5fb1555cad9ec/users/f0065ed595f8494da203278171cbcabe/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:08.557175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.567064 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced604f-cec2-4dee-8651-6787dafd5454 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.622153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.622772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.623054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.623328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.624048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.625683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751ec0-9742-4af6-ab0b-c8cb849f2352 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.635517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1139/2260] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:08.639744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.649751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d746ef-745d-492b-9d4c-438392296b5c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.654409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.655213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.655489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.655764 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] PATH_INFO: `/v3/projects/b717220d6e6249ff98e5fb1555cad9ec/users/f0065ed595f8494da203278171cbcabe/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.657766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b717220d6e6249ff98e5fb1555cad9ec, user_id=f0065ed595f8494da203278171cbcabe, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.660389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.670550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1122/2261] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:08 2022] PUT /identity/v3/projects/b717220d6e6249ff98e5fb1555cad9ec/users/f0065ed595f8494da203278171cbcabe/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:08.682163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.682451 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.682730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.711935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] MFA Rules not processed for user `f0065ed595f8494da203278171cbcabe`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:08.713437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:08.794557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1140/2262] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:08.807329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:08.809094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:08.872570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7481d-8a7a-4d8f-929a-72054837d104 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:08.876127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:08.876832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:08.877106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:08.877376 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:08.887368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:08.888910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001a06e-ccd8-4fc2-8bf4-332466654ec2 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:08.898965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1123/2263] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:09.075997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:09.085259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273ca4-f15d-4027-99b6-a9301330b875 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:09.088807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:09.089432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:09.089708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:09.089977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:09.154259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:09.157434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:09.167278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1141/2264] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:13.271893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:13.272453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:13.272538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:13.291481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] MFA Rules not processed for user `2d399ef4bd4e44febeeac8974f4c24e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:13.292687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:13.359993 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1124/2265] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:13.695237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:13.696740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:13.750210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854c46-d775-429b-ab14-f4318e8f7c4e service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:13.753785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:13.754416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:13.754692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:13.754966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:13.756704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:13.765970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:13.767374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:13.775059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1142/2266] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:16.583874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:16.587529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:16.658519 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc43de-d321-4f2f-bb5d-79044fa923d8 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:16.663893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:16.664602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:16.664888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:16.665189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:16.667502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:16.679921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:16.682103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:16.702875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1125/2267] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:17.923814 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:17.941615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148bf5-8f73-4aea-b6db-86b103f436f5 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:17.947105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:17.948230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:17.948922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:17.949360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:17.951509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:17.965491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:17.967859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b7467-ba10-4eab-87be-855809d542f2 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:17.986035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1143/2268] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:21.256235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:21.336201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162597-c3aa-4cb8-a55a-3c87a1359038 service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:21.341837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:21.342721 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:21.343060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:21.343338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] PATH_INFO: `/v3/users/487a2a21b23345feb341bd018ec34147` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:21.344610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487a2a21b23345feb341bd018ec34147)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:21.346633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:21.575779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487a2a21b23345feb341bd018ec34147'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:21.576449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487a2a21b23345feb341bd018ec34147'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:21.663457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487a2a21b23345feb341bd018ec34147'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:21.671082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487a2a21b23345feb341bd018ec34147'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:21.682895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487a2a21b23345feb341bd018ec34147'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:21.692800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1126/2269] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:21 2022] DELETE /identity/v3/users/487a2a21b23345feb341bd018ec34147 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:21.694903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:21.698407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:21.698407 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:21.715009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:21.716249 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:21.772627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1144/2270] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:30:21.782961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:21.784509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:21.841074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9252-0e6e-49b2-9f37-0879e92389f5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:21.844631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:21.845301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:21.845579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:21.845853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:21.854489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:21.855904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:21.865052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1127/2271] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:22.392422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:22.394437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:22.408689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470cc9-600b-4d7d-865b-16f07278f6b5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:22.415389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:22.416937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:22.417424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:22.417909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] PATH_INFO: `/v3/projects/605855a55e864b52ba9fe66eff1c9402` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:22.419231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] RBAC: Authorizing `identity:delete_project(project_id=605855a55e864b52ba9fe66eff1c9402)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:22.421995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:22.538903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605855a55e864b52ba9fe66eff1c9402', 'request_id': 'req-c8cb54d7-b2c8-401c-a703-d5f710da560c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.652437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605855a55e864b52ba9fe66eff1c9402', 'request_id': 'req-c8cb54d7-b2c8-401c-a703-d5f710da560c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.658328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605855a55e864b52ba9fe66eff1c9402', 'request_id': 'req-c8cb54d7-b2c8-401c-a703-d5f710da560c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.669565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] The token cache is being invalidate because project 605855a55e864b52ba9fe66eff1c9402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:22.669851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.670756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.672288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1145/2272] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:22 2022] DELETE /identity/v3/projects/605855a55e864b52ba9fe66eff1c9402 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:22.676356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:22.685994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b148d6-1cfe-42e4-a131-b0742e15eb44 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:22.753159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:22.754061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:22.754385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:22.754667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] PATH_INFO: `/v3/users/f0065ed595f8494da203278171cbcabe` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:22.755866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0065ed595f8494da203278171cbcabe)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:22.758093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:22.954197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0065ed595f8494da203278171cbcabe'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:22.955420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0065ed595f8494da203278171cbcabe'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.045992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0065ed595f8494da203278171cbcabe'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.058037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0065ed595f8494da203278171cbcabe'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.066114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d49a359c-d7b8-450b-b6cc-c03bd764fae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0065ed595f8494da203278171cbcabe'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.072252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1128/2273] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:22 2022] DELETE /identity/v3/users/f0065ed595f8494da203278171cbcabe => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:23.688025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:23.689521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:23.704856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb54d7-b2c8-401c-a703-d5f710da560c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:23.767448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:23.768320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:23.768652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:23.768904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] PATH_INFO: `/v3/projects/b717220d6e6249ff98e5fb1555cad9ec` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:23.770128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b717220d6e6249ff98e5fb1555cad9ec)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:23.772642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:23.874524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b717220d6e6249ff98e5fb1555cad9ec', 'request_id': 'req-0c33fb85-3728-42b3-8038-910fb1f0d7f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.936828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b717220d6e6249ff98e5fb1555cad9ec', 'request_id': 'req-0c33fb85-3728-42b3-8038-910fb1f0d7f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.943956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b717220d6e6249ff98e5fb1555cad9ec', 'request_id': 'req-0c33fb85-3728-42b3-8038-910fb1f0d7f8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.956704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] The token cache is being invalidate because project b717220d6e6249ff98e5fb1555cad9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:23.956995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.957675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0c33fb85-3728-42b3-8038-910fb1f0d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:23.959250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1146/2274] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:23 2022] DELETE /identity/v3/projects/b717220d6e6249ff98e5fb1555cad9ec => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:23.965770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:23.966301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:23.966301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:23.984031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:23.985269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:24.044448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1129/2275] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:24.052521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.052852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.053376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.071620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:24.073498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:24.081953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1147/2276] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:24.086134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.096333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da344004-0707-4ea5-98e9-8f7392ad635f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.101192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.101903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.102235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.102536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.103344 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:24.103646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.105274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.116581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1130/2277] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:30:24.120835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.129943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b689e-8d42-4bb5-934b-518cb79a1d75 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.135597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.136238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.142765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.142765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.142765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.142765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3e01-fa2a-46b3-b7b2-02937aa1907e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.230612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1148/2278] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:30:24.234761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.245654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c2ee-b119-4111-813b-e375bb0e9bba admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.303560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.304269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.304583 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.304857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.305564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.307982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.317485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.317485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.317485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.335956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] MFA Rules not processed for user `2bf19c9a86344181a1cadd65c2d2dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:24.337179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:24.392416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1149/2279] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:24.400438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1131/2280] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:30:24.404080 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.414659 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3724f9-1577-40cd-a035-f01ed5031c2a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.419526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.420542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.420826 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.426192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.426192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.426192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.434130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1150/2281] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:24.438045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.449200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3a4a-a120-4211-9049-05298346a276 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.455864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.455864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.455864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.455864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.456246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.457796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887bc3e-23d8-4d3b-8c4e-b8a66d373583 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.467983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1132/2282] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:24.472200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.485493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe6e0-4785-4056-9ce1-62bd2e67d8a5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.490996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.492063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.492347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.492691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] PATH_INFO: `/v3/projects/9749ce76048242cbaffd40d73dab1626/users/4912dd68ccef4cd89c7516822f8bc933/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.511292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9749ce76048242cbaffd40d73dab1626, user_id=4912dd68ccef4cd89c7516822f8bc933, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.514320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.587057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1151/2283] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:24 2022] PUT /identity/v3/projects/9749ce76048242cbaffd40d73dab1626/users/4912dd68ccef4cd89c7516822f8bc933/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:24.589120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.589512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.589891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.628845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] MFA Rules not processed for user `4912dd68ccef4cd89c7516822f8bc933`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:24.630215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:24.717415 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1133/2284] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:24.718087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.795570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4406c7-1d33-437d-93ac-ec3dfa174066 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.800928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.801654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.802149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.802263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.802872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.804785 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:24.893059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1152/2285] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:24.896766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:24.907314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3266-8e12-4eb2-b390-b012b6cf238f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:24.964251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:24.965042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:24.965505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:24.965719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:24.966432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:24.968443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.069094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1134/2286] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:24 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:25.073289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.083301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf856-cbe1-4569-87d3-dd01fd36f06d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.088526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.089178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.089458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.089734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.090489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.092078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.103592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1153/2287] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:25.108075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.119339 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf06f8-db5d-4a40-a882-14ef08f71f63 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.128015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.129384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.129687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.129931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] PATH_INFO: `/v3/projects/42655113f5cb40498d74a52d98fe3428/users/15c59f2a89fd4dfba628649cfd08dc02/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.157054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42655113f5cb40498d74a52d98fe3428, user_id=15c59f2a89fd4dfba628649cfd08dc02, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.159846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.239491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1135/2288] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:25 2022] PUT /identity/v3/projects/42655113f5cb40498d74a52d98fe3428/users/15c59f2a89fd4dfba628649cfd08dc02/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:30:25.243619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.254530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca917c6-d227-423c-8f15-1be2fce49c49 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.313660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.314325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.314606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.314878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.315590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.317223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5e370-128e-4e42-a49e-082cf45c33a0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.326841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1154/2289] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:25.331002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.342117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9f1f1-bbae-4e19-b334-6d25ee69c642 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.348511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.349400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.349689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.349970 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] PATH_INFO: `/v3/projects/42655113f5cb40498d74a52d98fe3428/users/15c59f2a89fd4dfba628649cfd08dc02/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.352073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42655113f5cb40498d74a52d98fe3428, user_id=15c59f2a89fd4dfba628649cfd08dc02, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.355461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.366112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1136/2290] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:25 2022] PUT /identity/v3/projects/42655113f5cb40498d74a52d98fe3428/users/15c59f2a89fd4dfba628649cfd08dc02/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:25.378953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.378953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.379225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.409218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] MFA Rules not processed for user `15c59f2a89fd4dfba628649cfd08dc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:25.410482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:25.475615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1155/2291] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:25.487769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.488706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:25.499254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.504775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:25.548592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014e2f2-7f98-4ca3-9cf8-24c2d0b2cb1e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.552498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.553172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.553444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.553713 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.564070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.565669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.575642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c441-bd45-48bd-bd4d-482795163bdd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.575816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1137/2292] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:25.581585 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.582230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.582508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.582781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.584630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:25.642471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.644216 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.654426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1156/2293] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:25.694675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:25.696134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:25.707917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154527bd-820a-4b12-9734-516500a41a51 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:25.711596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:25.712272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:25.713301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:25.717640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:25.772480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:25.774321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:25.784081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1138/2294] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:31.113621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:31.115897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:31.175777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:31.203152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b4239-719c-4542-bab5-2cb7f02bb22a service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:31.207144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:31.207867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:31.208172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:31.208689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:31.211002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:31.273384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb75e0-5922-436d-bb69-260c14849644 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:31.284112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:31.285407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:31.285899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:31.286473 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] PATH_INFO: `/v3/users/4912dd68ccef4cd89c7516822f8bc933` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:31.288757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4912dd68ccef4cd89c7516822f8bc933)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:31.292210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:31.304042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:31.306463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cee668-0ec6-4fd9-bbb1-9d1889bbd2e1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:31.324692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1157/2295] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:31.628191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4912dd68ccef4cd89c7516822f8bc933'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:31.631179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4912dd68ccef4cd89c7516822f8bc933'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:31.697733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4912dd68ccef4cd89c7516822f8bc933'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:31.706077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4912dd68ccef4cd89c7516822f8bc933'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:31.718458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4912dd68ccef4cd89c7516822f8bc933'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:31.725652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1139/2296] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:31 2022] DELETE /identity/v3/users/4912dd68ccef4cd89c7516822f8bc933 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:31.730871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:31.731231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:31.731578 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:31.751506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:31.752848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:31.821468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1158/2297] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:31.832712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:31.835780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:31.907012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8464a7-f1a3-4d9d-bfd6-044e95ae98ef admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:31.911777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:31.912462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:31.912961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:31.913271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:31.924094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:31.925839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:31.936965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1140/2298] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:32.835909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:32.839837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:32.855507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7fd4a-e9b3-42f2-a180-5b2e3c69d8af None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:32.861600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:32.862975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:32.863465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:32.863933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] PATH_INFO: `/v3/projects/9749ce76048242cbaffd40d73dab1626` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:32.865882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9749ce76048242cbaffd40d73dab1626)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:32.868032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:33.015743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9749ce76048242cbaffd40d73dab1626', 'request_id': 'req-ae6324e6-ecee-4f47-817b-6e794ba61de4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.104005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9749ce76048242cbaffd40d73dab1626', 'request_id': 'req-ae6324e6-ecee-4f47-817b-6e794ba61de4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.110489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9749ce76048242cbaffd40d73dab1626', 'request_id': 'req-ae6324e6-ecee-4f47-817b-6e794ba61de4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.125309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] The token cache is being invalidate because project 9749ce76048242cbaffd40d73dab1626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:33.125599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.126259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.127997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1159/2299] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:32 2022] DELETE /identity/v3/projects/9749ce76048242cbaffd40d73dab1626 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:33.132142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:33.144322 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f236de-ca8e-4033-b61d-2f93a5592cae service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:33.219450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:33.220663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:33.220952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:33.221245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] PATH_INFO: `/v3/users/15c59f2a89fd4dfba628649cfd08dc02` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:33.222718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c59f2a89fd4dfba628649cfd08dc02)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:33.224804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:33.380522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c59f2a89fd4dfba628649cfd08dc02'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.382998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c59f2a89fd4dfba628649cfd08dc02'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.469155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c59f2a89fd4dfba628649cfd08dc02'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.479111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c59f2a89fd4dfba628649cfd08dc02'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.492024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3a3276e9-101b-47d8-b079-7851fd4d7084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c59f2a89fd4dfba628649cfd08dc02'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:33.499242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1141/2300] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:33 2022] DELETE /identity/v3/users/15c59f2a89fd4dfba628649cfd08dc02 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:34.167998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:34.169716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:34.211271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6324e6-ecee-4f47-817b-6e794ba61de4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:34.301745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:34.303129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:34.303753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:34.304202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] PATH_INFO: `/v3/projects/42655113f5cb40498d74a52d98fe3428` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:34.305551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42655113f5cb40498d74a52d98fe3428)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:34.311650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:34.449137 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42655113f5cb40498d74a52d98fe3428', 'request_id': 'req-388892ab-16c9-46fb-ac45-8e2a6f79a106'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:34.583066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42655113f5cb40498d74a52d98fe3428', 'request_id': 'req-388892ab-16c9-46fb-ac45-8e2a6f79a106'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:34.600799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42655113f5cb40498d74a52d98fe3428', 'request_id': 'req-388892ab-16c9-46fb-ac45-8e2a6f79a106'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:34.622561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] The token cache is being invalidate because project 42655113f5cb40498d74a52d98fe3428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:34.625027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:34.625027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-388892ab-16c9-46fb-ac45-8e2a6f79a106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:34.630316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1160/2301] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:34 2022] DELETE /identity/v3/projects/42655113f5cb40498d74a52d98fe3428 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:34.632348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:34.632825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:34.633173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:34.670064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:34.672279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:34.782355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1142/2302] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:34.790729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:34.791085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:34.791275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:34.824986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:34.826270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:34.841131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1161/2303] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:34.845405 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:34.885279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479acffc-cfc0-4a2c-8ab2-d155ce69e045 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:34.898461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:34.901992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:34.901992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:34.901992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:34.901992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:34.901992 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:34.906590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:34.964791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1143/2304] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:30:34.964915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:34.973234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ebfb-515b-4571-a946-7c2c937d667b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:34.979179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:34.980096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:34.980447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:34.981339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:34.982257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:34.984861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.147289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1162/2305] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:34 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:35.156872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.166070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c3df-ccaf-4ab2-af8d-d3ba189c86b1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:35.282327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:35.283590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.283867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.284148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.285629 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:35.288997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.405943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1144/2306] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:35 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:35.410129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.421462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7d4d3-0175-4425-81fa-2ca757ceef23 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:35.426089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:35.427381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.427381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.427600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.428354 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:35.430085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.441647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1163/2307] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:35.448268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.463422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6321-ef6b-4bda-a502-5e696003c495 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:35.482206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:35.483006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.483512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.484296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.485068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:35.489668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f88cf6-64eb-4c10-b361-bf60304bacbc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.500559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1145/2308] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:35.504654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.517385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032e05-b56b-4df6-9972-221be71e3d76 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:35.522135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:35.523027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.523332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.523607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] PATH_INFO: `/v3/projects/9f75de4d78f24a71a2691d9806a5e41d/users/9e59a3d47bd64ce2b74230703e9bfc47/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.542965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f75de4d78f24a71a2691d9806a5e41d, user_id=9e59a3d47bd64ce2b74230703e9bfc47, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:35.547454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.624600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1164/2309] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:35 2022] PUT /identity/v3/projects/9f75de4d78f24a71a2691d9806a5e41d/users/9e59a3d47bd64ce2b74230703e9bfc47/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:35.641784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.642291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.642441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.672249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] MFA Rules not processed for user `9e59a3d47bd64ce2b74230703e9bfc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:35.673488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:35.749571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1146/2310] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:35.753647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.820704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9391-1eb4-4542-9024-a75e216f2d3b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:35.825993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:35.826682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:35.826963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:35.827234 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:35.827925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:35.829992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:35.947942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1165/2311] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:30:35.949199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:35.961990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4cb4-f2fb-4cd3-93bc-03c7688ff1f4 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.023307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.023913 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.024195 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.024510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.025223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.027227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.122570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1147/2312] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:35 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:36.130905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:36.145298 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a3378-0bad-41fe-9700-ffc78028ecad admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.150949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.152085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.152818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.153033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.153871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.157452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.173303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1166/2313] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:30:36.177743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:36.193565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d276c2-aaf3-49ef-ad26-fed77f6a42d4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.200012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.200940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.201225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.201505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] PATH_INFO: `/v3/projects/9b3c316e94c44967b82b140082654587/users/2bd295559380408cb27b75fd6572e4a9/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.226443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3c316e94c44967b82b140082654587, user_id=2bd295559380408cb27b75fd6572e4a9, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.230373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.317710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1148/2314] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:36 2022] PUT /identity/v3/projects/9b3c316e94c44967b82b140082654587/users/2bd295559380408cb27b75fd6572e4a9/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:36.321614 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:36.361053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d88cc-85d0-428d-a44e-a8c73d048a89 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.526579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.527952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.528483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.529151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.530633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.532555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb93cfa-e271-4e98-a001-d805e38b7a4a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.552558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1167/2315] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:36.554158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:36.567085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9495fc1-fa5a-47dc-bec9-3481d3b5eadb admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.576003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.577171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.577459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.577733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] PATH_INFO: `/v3/projects/9b3c316e94c44967b82b140082654587/users/2bd295559380408cb27b75fd6572e4a9/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.580547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3c316e94c44967b82b140082654587, user_id=2bd295559380408cb27b75fd6572e4a9, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.585525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.601602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1149/2316] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:36 2022] PUT /identity/v3/projects/9b3c316e94c44967b82b140082654587/users/2bd295559380408cb27b75fd6572e4a9/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:36.615179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.615179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.615179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.642233 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] MFA Rules not processed for user `2bd295559380408cb27b75fd6572e4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:36.643509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:36.720679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1168/2317] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:30:36.733492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:36.735292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:36.799411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b43f7-c60a-4d71-8120-4dbcf714efed admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:36.803380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:36.803973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:36.804252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:36.804646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:36.817569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:36.819097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:36.828815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1150/2318] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:38.367077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:38.379963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936614d-1684-48e9-8573-e871fd314a5e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:38.387523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd295559380408cb27b75fd6572e4a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b3c316e94c44967b82b140082654587', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:38.388230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:38.389095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:38.390188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:38.391166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:38.391730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:38.394299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:38.443424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:38.452626 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1169/2319] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:30:38.457552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c360bd-1d2c-4bda-8b2d-16240b36cd92 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:38.464642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd295559380408cb27b75fd6572e4a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b3c316e94c44967b82b140082654587', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:38.465811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:38.466483 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:38.466960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:38.467995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:38.470506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:38.620330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1151/2320] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:38 2022] POST /identity/v3/projects => generated 354 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:38.624510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:38.640095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196ab4d-3724-48d7-9ecc-e6acc336bfa8 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:38.758157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd295559380408cb27b75fd6572e4a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b3c316e94c44967b82b140082654587', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:38.758764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:38.759361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:38.759644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:38.760436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:38.761387 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:38.763402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:38.782293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1170/2321] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:30:38.851480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:38.872632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c00a3-b57c-47f4-8bc6-ccbd35c65890 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:38.891960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd295559380408cb27b75fd6572e4a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b3c316e94c44967b82b140082654587', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:38.894789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:38.894789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:38.894789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] PATH_INFO: `/v3/projects/97a1c9076c5d41fdbb8703f21252df6e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:38.896029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97a1c9076c5d41fdbb8703f21252df6e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:38.899366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:39.067436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a1c9076c5d41fdbb8703f21252df6e', 'request_id': 'req-1e685677-2eb5-432e-a9ea-eb76b357ee35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:39.078348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a1c9076c5d41fdbb8703f21252df6e', 'request_id': 'req-1e685677-2eb5-432e-a9ea-eb76b357ee35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:39.085884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a1c9076c5d41fdbb8703f21252df6e', 'request_id': 'req-1e685677-2eb5-432e-a9ea-eb76b357ee35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:39.224663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] The token cache is being invalidate because project 97a1c9076c5d41fdbb8703f21252df6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:39.230571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:39.230571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1e685677-2eb5-432e-a9ea-eb76b357ee35 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:39.230571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1152/2322] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:38 2022] DELETE /identity/v3/projects/97a1c9076c5d41fdbb8703f21252df6e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:39.900161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:39.905944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:40.007376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace2463-f02b-4b9a-b1fb-db1368d0bef6 tempest-VolumeQuotaClassesTest-2111936046 tempest-VolumeQuotaClassesTest-2111936046-project-admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:40.101003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:40.102231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:40.103502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:40.103977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] PATH_INFO: `/v3/users/9e59a3d47bd64ce2b74230703e9bfc47` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:40.106791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e59a3d47bd64ce2b74230703e9bfc47)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:40.109992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:40.370962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e59a3d47bd64ce2b74230703e9bfc47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:40.371932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e59a3d47bd64ce2b74230703e9bfc47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:40.382356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e59a3d47bd64ce2b74230703e9bfc47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:40.475838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e59a3d47bd64ce2b74230703e9bfc47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:40.500648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e59a3d47bd64ce2b74230703e9bfc47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:40.511794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1171/2323] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:39 2022] DELETE /identity/v3/users/9e59a3d47bd64ce2b74230703e9bfc47 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:40.515355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:40.515836 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:40.515919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:40.549758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:40.551226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:40.641940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1153/2324] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:40.651965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:40.653590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:40.742719 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf6a9-d1e7-45b9-a43c-3ecd9dbe0874 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:40.748446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:40.749471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:40.749898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:40.750399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:40.761886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:40.763904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:40.778839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1172/2325] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:41.297574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:41.299163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:41.316847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdc30-ad74-4606-a7c1-cae4c8ba119e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:41.340397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:41.345919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:41.347719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:41.347719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] PATH_INFO: `/v3/projects/9f75de4d78f24a71a2691d9806a5e41d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:41.351370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f75de4d78f24a71a2691d9806a5e41d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:41.353310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:41.512599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f75de4d78f24a71a2691d9806a5e41d', 'request_id': 'req-4603cb44-cbb4-46fe-99db-f174c24ed8cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.518941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f75de4d78f24a71a2691d9806a5e41d', 'request_id': 'req-4603cb44-cbb4-46fe-99db-f174c24ed8cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.532722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f75de4d78f24a71a2691d9806a5e41d', 'request_id': 'req-4603cb44-cbb4-46fe-99db-f174c24ed8cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.619003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] The token cache is being invalidate because project 9f75de4d78f24a71a2691d9806a5e41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:41.619294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.619900 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4603cb44-cbb4-46fe-99db-f174c24ed8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.621608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1154/2326] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:41 2022] DELETE /identity/v3/projects/9f75de4d78f24a71a2691d9806a5e41d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:41.625570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:41.636608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe434-1927-4d9f-9141-3b76e73cc1ca service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:41.703619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:41.704663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:41.705033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:41.705538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] PATH_INFO: `/v3/users/2bd295559380408cb27b75fd6572e4a9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:41.706967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd295559380408cb27b75fd6572e4a9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:41.710989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:41.836654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:41.836945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:41.837393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:41.855693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:41.857124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:41.873606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd295559380408cb27b75fd6572e4a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.874442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd295559380408cb27b75fd6572e4a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.884801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd295559380408cb27b75fd6572e4a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.920922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1155/2327] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:30:41.927007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd295559380408cb27b75fd6572e4a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.944125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd295559380408cb27b75fd6572e4a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:41.944563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:41.945927 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:41.950531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1173/2328] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:30:41 2022] DELETE /identity/v3/users/2bd295559380408cb27b75fd6572e4a9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:42.019545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1b27-0542-466b-a392-dc649f393a02 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:42.083093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:42.083660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:42.083939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:42.084212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:42.149290 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:42.151198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679d7bd-0c2c-4ca2-ae36-4970573d535b service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:42.162329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1156/2329] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 12:30:42.398696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:42.404577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:42.599911 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afa9f-aee4-4f83-a2a1-d2103cca71d9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:42.626414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:42.629676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:42.630302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:42.630751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] PATH_INFO: `/v3/projects/9b3c316e94c44967b82b140082654587` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:42.637584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3c316e94c44967b82b140082654587)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:42.639800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:42.860166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3c316e94c44967b82b140082654587', 'request_id': 'req-aaee7e86-267b-44db-bf9f-232ac223b655'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:42.983343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3c316e94c44967b82b140082654587', 'request_id': 'req-aaee7e86-267b-44db-bf9f-232ac223b655'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:42.993947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3c316e94c44967b82b140082654587', 'request_id': 'req-aaee7e86-267b-44db-bf9f-232ac223b655'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:43.027669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] The token cache is being invalidate because project 9b3c316e94c44967b82b140082654587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:30:43.028857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:43.031259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aaee7e86-267b-44db-bf9f-232ac223b655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:30:43.038801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1174/2330] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:30:42 2022] DELETE /identity/v3/projects/9b3c316e94c44967b82b140082654587 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:43.043060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.043606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.043966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.074176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:43.075484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:43.195787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1157/2331] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:43.197245 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.197535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.197820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.222850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:43.224350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:43.234458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1175/2332] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:30:43.237921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.268534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da424e28-ee57-4314-80e0-2348fdf91382 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.275485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.278806 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.279318 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.279591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.280850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:30:43.280850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.307098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.338499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1158/2333] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:30:43.340151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.355828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b658-8375-4688-a92d-22f37a1b9054 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.361398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.362038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.362388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.362726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.363503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.365518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.460048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1176/2334] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:43 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:43.461183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.473638 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389d5e7-ad4a-4355-9351-1b7528ed0d0e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.542414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.543391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.543744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.544688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.545781 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.547753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.664321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1159/2335] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:43 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:43.668112 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.680012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4797-1388-4e36-afe9-55f0707c44c1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.689192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.691597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.691597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.691597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.691597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.693460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.705896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1177/2336] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:43.709730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.724190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb9730-5603-467a-81d2-57b5561fa40a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.732078 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.732769 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.733050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.733323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.734061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.735690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667171-816a-49da-a2e0-b0dc8b50d456 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.761039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1160/2337] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:43.765251 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:43.776243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483cdc8-26d0-48b0-9079-c8b6a990db1a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:43.781400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:43.782307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.782590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.782862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] PATH_INFO: `/v3/projects/208c61bd7ef94f2aba794ea6bf5da069/users/11f80a025e3b44bc911a43ef02442a77/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.798695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208c61bd7ef94f2aba794ea6bf5da069, user_id=11f80a025e3b44bc911a43ef02442a77, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:43.801429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:43.890666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1178/2338] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:43 2022] PUT /identity/v3/projects/208c61bd7ef94f2aba794ea6bf5da069/users/11f80a025e3b44bc911a43ef02442a77/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:43.896245 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d97f1-9841-4d24-b0aa-6ad54ff6e38c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:43.896817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d97f1-9841-4d24-b0aa-6ad54ff6e38c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:43.897229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d97f1-9841-4d24-b0aa-6ad54ff6e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:43.920796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2f0d97f1-9841-4d24-b0aa-6ad54ff6e38c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:43.922226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2f0d97f1-9841-4d24-b0aa-6ad54ff6e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:43.998982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1161/2339] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:44.009718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:44.011411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:44.075970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e748ff-f471-4603-a84f-3f20142e9cf9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:44.080042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:44.080852 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:44.081226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:44.081595 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:44.091257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:44.092857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:44.105927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1179/2340] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:45.545095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:45.546009 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:45.546120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:45.579875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] MFA Rules not processed for user `11f80a025e3b44bc911a43ef02442a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:45.581213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:45.756242 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1162/2341] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:45.757301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:45.768994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb626b-9808-44d9-af18-141dcd1137a1 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:45.773695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:45.774355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:45.774635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:45.774930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:45.775593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:45.777810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:45.872395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1180/2342] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:30:45 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:30:45.875661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:45.887594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a6fd3-ce31-4c8a-b2ea-32c37d8cc081 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:45.953884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:45.954840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:45.956585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:45.956996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:45.957613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:45.959552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:46.046831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1163/2343] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:30:45 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:30:46.050889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:46.063907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea16a3-62df-4863-b887-403039ca2a30 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:46.069687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:46.070480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:46.070864 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:46.071260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:46.072077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:46.073827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:46.088469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1181/2344] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:30:46.092555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:46.107142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd35-5626-401b-8a13-5f74bceeb14e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:46.112086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:46.113007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:46.113282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:46.113547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] PATH_INFO: `/v3/projects/1d3b68a697414e0b9d3946d0876acdc2/users/554cce37ab4d45ed8f75d8937d2c6658/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:46.129105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3b68a697414e0b9d3946d0876acdc2, user_id=554cce37ab4d45ed8f75d8937d2c6658, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:46.131765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:46.222458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1164/2345] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:46 2022] PUT /identity/v3/projects/1d3b68a697414e0b9d3946d0876acdc2/users/554cce37ab4d45ed8f75d8937d2c6658/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:46.224908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:46.236066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18624107-0999-4762-94ef-6138426df3ca admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:46.321808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:46.322481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:46.322763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:46.323034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:46.323754 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:46.325525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5abe54-0e7c-4b7f-9b2a-f6a409424fb0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:46.340415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1182/2346] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:30:46.342814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:46.357012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c4d3-40aa-4892-b452-bdae6e5c428b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:46.363178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:46.364073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:46.364357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:46.364676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] PATH_INFO: `/v3/projects/1d3b68a697414e0b9d3946d0876acdc2/users/554cce37ab4d45ed8f75d8937d2c6658/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:46.366656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3b68a697414e0b9d3946d0876acdc2, user_id=554cce37ab4d45ed8f75d8937d2c6658, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:46.369363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:46.382739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1165/2347] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:30:46 2022] PUT /identity/v3/projects/1d3b68a697414e0b9d3946d0876acdc2/users/554cce37ab4d45ed8f75d8937d2c6658/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:30:47.658801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059561e-e81c-407e-adab-a020212f502f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:47.659367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059561e-e81c-407e-adab-a020212f502f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:47.659558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059561e-e81c-407e-adab-a020212f502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:47.702951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0059561e-e81c-407e-adab-a020212f502f None None] MFA Rules not processed for user `554cce37ab4d45ed8f75d8937d2c6658`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:47.704330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0059561e-e81c-407e-adab-a020212f502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:47.836584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1183/2348] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:47.849718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:47.851349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:47.921316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a15a-2c36-4a30-bc9d-28aba681f163 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:47.925088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:47.925753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:47.926035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:47.926301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:47.988998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:47.990462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5d6bd-c810-45bb-b4c8-351f7f14b936 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:48.000093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1166/2349] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:49.945949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059561e-e81c-407e-adab-a020212f502f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:49.947592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0059561e-e81c-407e-adab-a020212f502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:49.964819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059561e-e81c-407e-adab-a020212f502f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:49.969119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:49.969764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:49.970044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:49.970317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:49.982282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:49.983701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccd735-9442-4818-89fc-4b5a62caaa33 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:49.995484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1184/2350] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:59.551013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:59.551586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:59.551680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:59.553148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1167/2351] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:30:59.559093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c5ac-7cc3-4f54-be04-c3332f7efcce None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:59.559603 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c5ac-7cc3-4f54-be04-c3332f7efcce None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:59.559699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c5ac-7cc3-4f54-be04-c3332f7efcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:59.577945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe28c5ac-7cc3-4f54-be04-c3332f7efcce None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:59.579221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe28c5ac-7cc3-4f54-be04-c3332f7efcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:59.644816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1185/2352] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:30:59.662082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:30:59.663794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:59.720825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5188c3-65d4-41fb-9a82-9ef9dcdc5194 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:30:59.724481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:30:59.725116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:59.725395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:59.725669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:59.736219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:30:59.737818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ca01-552b-4b59-acef-a02ac9dd7f67 service glance] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:30:59.748649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1168/2353] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:30:59.916096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:59.916673 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:59.916781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:59.923501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1186/2354] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:30:59.928648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787865-2eeb-45b2-85e6-0ba6e82877e3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:30:59.929015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787865-2eeb-45b2-85e6-0ba6e82877e3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:30:59.929301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787865-2eeb-45b2-85e6-0ba6e82877e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:30:59.947791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-36787865-2eeb-45b2-85e6-0ba6e82877e3 None None] MFA Rules not processed for user `fddb5e13094f454283de3020e1febc61`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:30:59.949050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-36787865-2eeb-45b2-85e6-0ba6e82877e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:30:59.998541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1169/2355] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:00.010737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:00.012445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:00.025939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a760-fccb-489b-9049-a25a1908b170 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:00.029464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:00.030094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:00.030374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:00.030646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:00.037465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:00.038877 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701103d-59dc-40fd-9de1-f04b7f81dc5b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:00.046696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1187/2356] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:00.125756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51965a-7926-4f99-b957-703ebe61058e None None] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:00.126050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51965a-7926-4f99-b957-703ebe61058e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:00.126331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51965a-7926-4f99-b957-703ebe61058e None None] PATH_INFO: `/` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:00.127737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1170/2357] 10.222.0.21 () {54 vars in 921 bytes} [Tue May 3 12:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 12:31:00.133423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fba9d-4c69-4d62-9c26-4f7b817e44aa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:00.134222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fba9d-4c69-4d62-9c26-4f7b817e44aa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:00.134496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fba9d-4c69-4d62-9c26-4f7b817e44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:00.152847 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1f5fba9d-4c69-4d62-9c26-4f7b817e44aa None None] MFA Rules not processed for user `1222910d5aea4308ae5083faf6bc753a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:00.154034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1f5fba9d-4c69-4d62-9c26-4f7b817e44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:00.163266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1188/2358] 10.222.0.21 () {58 vars in 1018 bytes} [Tue May 3 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:00.173508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51965a-7926-4f99-b957-703ebe61058e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:00.184241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51965a-7926-4f99-b957-703ebe61058e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:00.187830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:00.188485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:00.188773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:00.189050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:00.199449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:00.200902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:00.211330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1171/2359] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:04.732885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:04.733756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:04.734030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:04.752931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:04.754114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:04.822195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1189/2360] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:04.834978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:04.836648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:04.906494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c0e6-5d42-4d65-bb25-e62fee261b57 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:04.911574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:04.912226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:04.912582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:04.912867 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:04.921838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:04.923521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:04.932931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1172/2361] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:31:05.865907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:05.947485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755ee9-a494-4055-9644-86bdd6112f03 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:05.952568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:05.953543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:05.953882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:05.954219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] PATH_INFO: `/v3/users/11f80a025e3b44bc911a43ef02442a77` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:05.955640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f80a025e3b44bc911a43ef02442a77)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:05.958166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:06.170124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f80a025e3b44bc911a43ef02442a77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:06.171054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f80a025e3b44bc911a43ef02442a77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:06.177961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f80a025e3b44bc911a43ef02442a77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:06.245999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f80a025e3b44bc911a43ef02442a77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:06.261803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f80a025e3b44bc911a43ef02442a77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:06.267774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1190/2362] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:05 2022] DELETE /identity/v3/users/11f80a025e3b44bc911a43ef02442a77 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:06.528979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:06.540437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511296a5-1525-4741-8251-bc382cdfd63a service swift] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:06.660730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:06.661811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:06.662096 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:06.662368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] PATH_INFO: `/v3/projects/208c61bd7ef94f2aba794ea6bf5da069` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:06.663942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=208c61bd7ef94f2aba794ea6bf5da069)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:06.665930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:07.027287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208c61bd7ef94f2aba794ea6bf5da069', 'request_id': 'req-f76563ca-10d3-45d4-9ba2-88b06e666f6a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.061942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208c61bd7ef94f2aba794ea6bf5da069', 'request_id': 'req-f76563ca-10d3-45d4-9ba2-88b06e666f6a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.061942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208c61bd7ef94f2aba794ea6bf5da069', 'request_id': 'req-f76563ca-10d3-45d4-9ba2-88b06e666f6a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.360451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] The token cache is being invalidate because project 208c61bd7ef94f2aba794ea6bf5da069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:07.360658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.361381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.363036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1173/2363] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:06 2022] DELETE /identity/v3/projects/208c61bd7ef94f2aba794ea6bf5da069 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:07.367341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:07.370296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:07.384699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a6258-f4a9-4d43-8192-3e0ec152ffa6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:07.457447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:07.458744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:07.458744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:07.459151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] PATH_INFO: `/v3/users/554cce37ab4d45ed8f75d8937d2c6658` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:07.460632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=554cce37ab4d45ed8f75d8937d2c6658)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:07.462737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:07.689695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554cce37ab4d45ed8f75d8937d2c6658'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.690554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554cce37ab4d45ed8f75d8937d2c6658'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.698143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554cce37ab4d45ed8f75d8937d2c6658'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.742781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554cce37ab4d45ed8f75d8937d2c6658'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.757622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720d8bde-dc00-459b-b39c-4b138cb193bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554cce37ab4d45ed8f75d8937d2c6658'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:07.767383 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1191/2364] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:07 2022] DELETE /identity/v3/users/554cce37ab4d45ed8f75d8937d2c6658 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:08.123323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.125386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:08.151420 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76563ca-10d3-45d4-9ba2-88b06e666f6a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.235813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.236720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.237004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.237328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] PATH_INFO: `/v3/projects/1d3b68a697414e0b9d3946d0876acdc2` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.238522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3b68a697414e0b9d3946d0876acdc2)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.241041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.357412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3b68a697414e0b9d3946d0876acdc2', 'request_id': 'req-19414c05-50e4-4385-9ffa-d216cf977607'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:08.365156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3b68a697414e0b9d3946d0876acdc2', 'request_id': 'req-19414c05-50e4-4385-9ffa-d216cf977607'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:08.376408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3b68a697414e0b9d3946d0876acdc2', 'request_id': 'req-19414c05-50e4-4385-9ffa-d216cf977607'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:08.440071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] The token cache is being invalidate because project 1d3b68a697414e0b9d3946d0876acdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:08.440528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:08.441164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19414c05-50e4-4385-9ffa-d216cf977607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:08.443003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1174/2365] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:08 2022] DELETE /identity/v3/projects/1d3b68a697414e0b9d3946d0876acdc2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:08.448306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.449231 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.449738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.469881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:08.471094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:08.531705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1192/2366] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:08.539447 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.540269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.540593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.559819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:08.561054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:08.569187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1175/2367] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:31:08.573662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.583386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285704b3-d387-4f38-b196-8ceeea6d46ae None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.588607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.589275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.589568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.589836 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.590558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:31:08.590868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.592496 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.608050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1193/2368] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:31:08.613025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.619673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e6d6-621e-435c-8c38-10b9a641b752 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.624591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.625253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.625535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.625809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.626513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.628562 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.709888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1176/2369] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:08.714996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.725274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb744-675d-4abf-b962-d5fc0b403caf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.786456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.787414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.787862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.788299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.789196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.791909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.893790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1194/2370] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:31:08 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:31:08.898249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.910207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ff31-08a1-4e7a-b7a8-edc862be7a99 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.915686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.916546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.916835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.917117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.918123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.919748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.933909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1177/2371] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:08.935140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.945689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e0ca-1d81-4f1c-bec1-2ca725a7389c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.951055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.951724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.952005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.952338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:08.953091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:08.954721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3db2-87ea-440f-9441-0ab8eaaf215f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:08.969053 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1195/2372] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:08.970186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:08.980178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8356-03d0-41ef-b795-b8ab7cbeab1e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:08.986371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:08.987795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:08.988414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:08.988905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] PATH_INFO: `/v3/projects/b2cc2e231d53426cbecb23b6446ae3aa/users/0a40a19e0d4248e1a62f6a174bcc2ff9/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:09.005639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cc2e231d53426cbecb23b6446ae3aa, user_id=0a40a19e0d4248e1a62f6a174bcc2ff9, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:09.008916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:09.080948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1178/2373] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:31:08 2022] PUT /identity/v3/projects/b2cc2e231d53426cbecb23b6446ae3aa/users/0a40a19e0d4248e1a62f6a174bcc2ff9/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:09.104858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:09.105577 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:09.105959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:09.168643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] MFA Rules not processed for user `0a40a19e0d4248e1a62f6a174bcc2ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:09.170132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:09.335475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1196/2374] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:09.357785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:09.372226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:09.480559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b89fa-82d0-485d-a175-1b1fa39d5723 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:09.484237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:09.484973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:09.485254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:09.485524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:09.528283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:09.530746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdde4c-05a8-4fe8-a17b-81d00ce66202 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:09.543643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1179/2375] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:09.582442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:09.663952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07f8b3-1f7c-45f5-a06c-83cffae9d8d8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:09.670487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:09.671846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:09.672348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:09.672938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] PATH_INFO: `/v3/users/0a40a19e0d4248e1a62f6a174bcc2ff9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:09.674475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a40a19e0d4248e1a62f6a174bcc2ff9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:09.685856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:09.906415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a40a19e0d4248e1a62f6a174bcc2ff9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:09.907344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a40a19e0d4248e1a62f6a174bcc2ff9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:09.921502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a40a19e0d4248e1a62f6a174bcc2ff9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:10.012176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a40a19e0d4248e1a62f6a174bcc2ff9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:10.031364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a40a19e0d4248e1a62f6a174bcc2ff9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:10.040215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1197/2376] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:09 2022] DELETE /identity/v3/users/0a40a19e0d4248e1a62f6a174bcc2ff9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:10.045501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:10.046158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:10.046348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:10.063259 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:10.064476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:10.128969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1180/2377] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:10.140404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:10.141114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:10.202040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6757b-92ec-46f5-9f97-dff6447d4823 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:10.205973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:10.206638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:10.206919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:10.207193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:10.217783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:10.223125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02948848-36fd-4e16-86a4-416bb160278a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:10.230778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1198/2378] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:10.864520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:10.865960 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:10.886464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899cc30-d379-484b-be2b-c4ab1cb479c0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:10.904443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:10.905336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:10.905617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:10.905889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] PATH_INFO: `/v3/projects/b2cc2e231d53426cbecb23b6446ae3aa` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:10.910492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cc2e231d53426cbecb23b6446ae3aa)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:10.921632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.039090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cc2e231d53426cbecb23b6446ae3aa', 'request_id': 'req-b82af45f-6e7f-486a-aa8d-d6aecc882295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:11.050145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cc2e231d53426cbecb23b6446ae3aa', 'request_id': 'req-b82af45f-6e7f-486a-aa8d-d6aecc882295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:11.056057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cc2e231d53426cbecb23b6446ae3aa', 'request_id': 'req-b82af45f-6e7f-486a-aa8d-d6aecc882295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:11.103712 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] The token cache is being invalidate because project b2cc2e231d53426cbecb23b6446ae3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:11.103997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:11.104914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b82af45f-6e7f-486a-aa8d-d6aecc882295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:11.111189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1181/2379] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:10 2022] DELETE /identity/v3/projects/b2cc2e231d53426cbecb23b6446ae3aa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:11.112286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.112871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.112954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.131619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:11.132899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:11.204474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1199/2380] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:31:11.212950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.213240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.213520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.235454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:11.236642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:11.245065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1182/2381] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:31:11.249569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.260824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682f20-1445-4727-9d1d-a235889c2566 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.265584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.266247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.266529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.267033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.267821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:31:11.268127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.269772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.283553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1200/2382] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:31:11.288001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.300587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326061d7-720c-4959-880f-f694d3f42ad0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.305456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.306153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.306438 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.306745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.307601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.310169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.413432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1183/2383] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:11.417694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.429543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0623d-e23f-4aba-8daf-bc2cc2edf178 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.487604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.488250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.488500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.488770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.489450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.491350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.597564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1201/2384] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:11.598934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.610206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022976-19f9-4b10-9560-05825b13e0de admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.615602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.616279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.616593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.616870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.618134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.619741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.636309 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1184/2385] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:11.640392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.650606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c36f8-2354-4bec-b0b9-34372147c551 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.661569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.661569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.668691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.669065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.669851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.671758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0499-b321-4237-b1b6-c57588a56b54 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.692985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1202/2386] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:11.697520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:11.707765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a65b6-34ce-4ddb-b7c5-914e6845425a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:11.713148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:11.714170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.714481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.714762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] PATH_INFO: `/v3/projects/94bc5219e65741adad22d43a3c19c58d/users/92c1fa7234b24e7e9242839b3fd694f1/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.732742 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bc5219e65741adad22d43a3c19c58d, user_id=92c1fa7234b24e7e9242839b3fd694f1, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:11.736772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:11.823714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1185/2387] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:31:11 2022] PUT /identity/v3/projects/94bc5219e65741adad22d43a3c19c58d/users/92c1fa7234b24e7e9242839b3fd694f1/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:11.834928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:11.835227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:11.835507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:11.880399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] MFA Rules not processed for user `92c1fa7234b24e7e9242839b3fd694f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:11.881907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:11.982246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1203/2388] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:11.983458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.068682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c2f4-7d0e-4676-bc82-adf884dae4ba admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.077723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.078535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.079672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.079672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.080060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.082150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.212630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1186/2389] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:31:11 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:12.213742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.238648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14250-10ce-4e5f-bc32-faed7aedc2b9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.309975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.310571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.310855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.311122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.311807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.313755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.418290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1204/2390] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:31:12 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:31:12.422338 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.432487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89f64-f3a6-4020-9ced-e5ef84fb6301 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.437725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.438570 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.438855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.439267 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.440013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.442053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.456431 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1187/2391] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:12.457950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.469227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051429-b82d-44dc-981e-9e849e3516cf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.473925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.474627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.474908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.475180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.475902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.478148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397d7ba-b999-4e18-b3a9-c37dc11c7cd6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.488522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1205/2392] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:31:12.492874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.503269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672291-2e16-4e3c-a598-d001508ecea8 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.508065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.509272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.509549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.509820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] PATH_INFO: `/v3/projects/e741c2fe1d9a4c92a4d620bb81dd897d/users/a43931b29ee543ec8dfbf9bb56a32ee0/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.529150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e741c2fe1d9a4c92a4d620bb81dd897d, user_id=a43931b29ee543ec8dfbf9bb56a32ee0, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.531708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.601379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1188/2393] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:31:12 2022] PUT /identity/v3/projects/e741c2fe1d9a4c92a4d620bb81dd897d/users/a43931b29ee543ec8dfbf9bb56a32ee0/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:12.611929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.612219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.612743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.643360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] MFA Rules not processed for user `a43931b29ee543ec8dfbf9bb56a32ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:12.644609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:12.712641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1206/2394] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:12.717283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.787452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170712-817a-45c7-b7fd-929209eba308 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:12.793487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:12.794317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:12.794604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:12.794881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:12.795714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:12.797808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:12.918152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1189/2395] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:31:12 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:12.922056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:12.936315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76daf1-f988-43db-9ed4-52ebcc7fa8c0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.019834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.020555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.020843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.021179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.021811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.024620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.117445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1207/2396] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:31:12 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:31:13.120955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:13.138933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3728d3-bf2c-45d7-bb77-02153c5824cf admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.143745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.148505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.148505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.148505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.148505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.148505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.162600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1190/2397] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:13.166924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:13.178505 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692f86-32d1-4a61-af1a-a792eb68c13e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.188818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.189714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.191275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.191658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] PATH_INFO: `/v3/projects/f69371d0b83b41a39fe665593f69ffd5/users/ce45508783e84497ad360a9a5ab44210/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.207147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69371d0b83b41a39fe665593f69ffd5, user_id=ce45508783e84497ad360a9a5ab44210, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.209825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.290040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1208/2398] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:31:13 2022] PUT /identity/v3/projects/f69371d0b83b41a39fe665593f69ffd5/users/ce45508783e84497ad360a9a5ab44210/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:13.293916 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:13.314022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413a44d-1488-4bf6-a151-259507cde862 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.397121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.398058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.398508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.399525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.400458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.402285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44633946-3d0a-4902-ae5e-9de5f8d0c6e6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.416669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1191/2399] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:31:13.417432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:13.429399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df380-445d-4f90-a98e-ad2f615ec684 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.436906 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.437819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.438101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.438376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] PATH_INFO: `/v3/projects/f69371d0b83b41a39fe665593f69ffd5/users/ce45508783e84497ad360a9a5ab44210/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.440446 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69371d0b83b41a39fe665593f69ffd5, user_id=ce45508783e84497ad360a9a5ab44210, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.453047 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.464449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1209/2400] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:31:13 2022] PUT /identity/v3/projects/f69371d0b83b41a39fe665593f69ffd5/users/ce45508783e84497ad360a9a5ab44210/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:31:13.474746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.475035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.475632 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.502948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] MFA Rules not processed for user `ce45508783e84497ad360a9a5ab44210`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:13.504758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:13.573846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1192/2401] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:13.585063 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:13.588555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:13.647374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1c8a-f759-4daf-af07-6dc062115a70 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:13.651568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:13.652246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:13.652605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:13.652880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:13.708977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:13.710812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:13.720494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1210/2402] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:15.655547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:15.657021 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:15.669579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5565c-8a48-4dcf-aca4-7376a1112f6b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:15.673520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:15.674166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:15.680677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:15.680677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:15.734016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:15.735486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:15.745137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1193/2403] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:17.124631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:17.132838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fada9-dcac-4bcf-9e5f-5979d27cb7b7 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:17.136898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:17.137523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:17.137803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:17.138077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:17.146683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:17.148078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179001f-5d67-4c6c-8bce-ec82378be137 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:17.157883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1211/2404] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:22.123472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:22.184265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d5567-a0a4-40a5-a035-b99f76561a44 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:22.188708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:22.189575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:22.192986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:22.192986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] PATH_INFO: `/v3/users/92c1fa7234b24e7e9242839b3fd694f1` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:22.192986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c1fa7234b24e7e9242839b3fd694f1)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:22.193306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:22.407110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c1fa7234b24e7e9242839b3fd694f1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:22.407757 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c1fa7234b24e7e9242839b3fd694f1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:22.496684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c1fa7234b24e7e9242839b3fd694f1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:22.504688 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c1fa7234b24e7e9242839b3fd694f1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:22.519088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c1fa7234b24e7e9242839b3fd694f1'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:22.526020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1194/2405] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:22 2022] DELETE /identity/v3/users/92c1fa7234b24e7e9242839b3fd694f1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:22.530825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fc2c-1397-401a-8427-4ce900cb0137 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:22.531337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fc2c-1397-401a-8427-4ce900cb0137 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:22.531429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fc2c-1397-401a-8427-4ce900cb0137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:22.558460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5a98fc2c-1397-401a-8427-4ce900cb0137 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:22.558460 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a98fc2c-1397-401a-8427-4ce900cb0137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:22.620835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1212/2406] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:31:22.633218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:22.633218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:22.640260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:22.640604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:22.640903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:22.660092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:31:22.661899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:22.700838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14813-9ea5-4ae5-9cc2-6aeb63e3e098 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:22.704940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:22.705617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:22.705892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:22.706174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:22.717082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:22.718819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1213/2407] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:31:22.719200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:22.730834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1195/2408] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:22.735965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:22.737649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:22.807973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c6b3e-b422-4c77-a696-da1d8f55dc49 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:22.816279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:22.817163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:22.817445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:22.817726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:22.829768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:22.832083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:22.842263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1214/2409] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:31:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 12:31:23.898917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:23.901213 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:23.919006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf04f7-fe95-4bc0-beb1-8c5deb851415 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:23.925219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:23.926091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:23.926337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:23.926746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] PATH_INFO: `/v3/projects/94bc5219e65741adad22d43a3c19c58d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:23.927886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bc5219e65741adad22d43a3c19c58d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:23.929850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:24.016826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bc5219e65741adad22d43a3c19c58d', 'request_id': 'req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.025882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bc5219e65741adad22d43a3c19c58d', 'request_id': 'req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.031644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bc5219e65741adad22d43a3c19c58d', 'request_id': 'req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.136931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] The token cache is being invalidate because project 94bc5219e65741adad22d43a3c19c58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:24.137220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.137942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.139691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1196/2410] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:23 2022] DELETE /identity/v3/projects/94bc5219e65741adad22d43a3c19c58d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:24.143956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:24.158539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eb883-f270-4f8d-bd84-553cf73c6973 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:24.233097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:24.234094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:24.234380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:24.234653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] PATH_INFO: `/v3/users/a43931b29ee543ec8dfbf9bb56a32ee0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:24.235875 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43931b29ee543ec8dfbf9bb56a32ee0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:24.238647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:24.444788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43931b29ee543ec8dfbf9bb56a32ee0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.445724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43931b29ee543ec8dfbf9bb56a32ee0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.454546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43931b29ee543ec8dfbf9bb56a32ee0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.577196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43931b29ee543ec8dfbf9bb56a32ee0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.589167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43931b29ee543ec8dfbf9bb56a32ee0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:24.594941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1215/2411] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:24 2022] DELETE /identity/v3/users/a43931b29ee543ec8dfbf9bb56a32ee0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:31:25.116270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:25.117838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:25.131321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c5ee-3614-4b26-9a41-0bf2b7c83fc7 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:25.197493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:25.198346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:25.198607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:25.198875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] PATH_INFO: `/v3/projects/e741c2fe1d9a4c92a4d620bb81dd897d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:25.200055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e741c2fe1d9a4c92a4d620bb81dd897d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:25.201980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:25.302716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e741c2fe1d9a4c92a4d620bb81dd897d', 'request_id': 'req-33048e77-95ec-4e7e-a403-3c892127c5dd'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.309353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e741c2fe1d9a4c92a4d620bb81dd897d', 'request_id': 'req-33048e77-95ec-4e7e-a403-3c892127c5dd'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.314563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e741c2fe1d9a4c92a4d620bb81dd897d', 'request_id': 'req-33048e77-95ec-4e7e-a403-3c892127c5dd'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.376140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] The token cache is being invalidate because project e741c2fe1d9a4c92a4d620bb81dd897d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:25.376455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.377363 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.380240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1197/2412] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:25 2022] DELETE /identity/v3/projects/e741c2fe1d9a4c92a4d620bb81dd897d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:25.384151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:25.387840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:25.409309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec347d-e92d-44df-8a6d-54bc3398afac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:25.469599 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:25.470479 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:25.470758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:25.471054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] PATH_INFO: `/v3/users/ce45508783e84497ad360a9a5ab44210` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:25.472246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce45508783e84497ad360a9a5ab44210)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:25.474288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:25.693481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce45508783e84497ad360a9a5ab44210'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.694133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce45508783e84497ad360a9a5ab44210'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.701027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce45508783e84497ad360a9a5ab44210'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.754207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce45508783e84497ad360a9a5ab44210'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.766339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce45508783e84497ad360a9a5ab44210'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:25.772069 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1216/2413] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:31:25 2022] DELETE /identity/v3/users/ce45508783e84497ad360a9a5ab44210 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:26.253647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:26.255106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:26.270872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048e77-95ec-4e7e-a403-3c892127c5dd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:26.342126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:26.343027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:26.343450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:26.343761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] PATH_INFO: `/v3/projects/f69371d0b83b41a39fe665593f69ffd5` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:26.344977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69371d0b83b41a39fe665593f69ffd5)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:26.348341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:26.463063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69371d0b83b41a39fe665593f69ffd5', 'request_id': 'req-19cc6072-0d39-450d-af8a-649e4e45b0d2'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:26.469271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69371d0b83b41a39fe665593f69ffd5', 'request_id': 'req-19cc6072-0d39-450d-af8a-649e4e45b0d2'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:26.474631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69371d0b83b41a39fe665593f69ffd5', 'request_id': 'req-19cc6072-0d39-450d-af8a-649e4e45b0d2'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:26.559585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] The token cache is being invalidate because project f69371d0b83b41a39fe665593f69ffd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:31:26.559966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:26.561159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:31:26.563315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1198/2414] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:31:26 2022] DELETE /identity/v3/projects/f69371d0b83b41a39fe665593f69ffd5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:31:59.780625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:59.782051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:59.838308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2106-ed15-4cac-8cf0-81b22d52965a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:59.882930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:31:59.884352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:59.886034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:59.886699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:59.886987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:59.887252 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:59.889121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:59.896767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6072-0d39-450d-af8a-649e4e45b0d2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:31:59.900346 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:31:59.901101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:31:59.901443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:31:59.901779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:31:59.903594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:31:59.951786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:59.953165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:59.962855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1217/2415] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:31:59.964458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:31:59.965883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:31:59.975625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1199/2416] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:05.327983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:05.330098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:05.348003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8a097-fa9d-464f-abcb-eca50b4f9b9b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:05.363902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:05.364933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:05.365442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:05.365730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] PATH_INFO: `/v3/users/2d399ef4bd4e44febeeac8974f4c24e9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:05.371821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d399ef4bd4e44febeeac8974f4c24e9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:05.371821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:05.610228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d399ef4bd4e44febeeac8974f4c24e9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:05.611187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d399ef4bd4e44febeeac8974f4c24e9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:05.627768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d399ef4bd4e44febeeac8974f4c24e9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:05.708292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d399ef4bd4e44febeeac8974f4c24e9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:05.718987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d399ef4bd4e44febeeac8974f4c24e9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:05.726049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1218/2417] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:05 2022] DELETE /identity/v3/users/2d399ef4bd4e44febeeac8974f4c24e9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:05.765227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:05.768655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:05.791782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea31d1-b6d3-43e7-ac35-0fdaf49654e4 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:05.877770 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:05.879018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:05.879308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:05.879588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] PATH_INFO: `/v3/users/2bf19c9a86344181a1cadd65c2d2dcc3` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:05.882012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf19c9a86344181a1cadd65c2d2dcc3)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:05.884675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.033123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.035376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.066067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf19c9a86344181a1cadd65c2d2dcc3'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.066763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf19c9a86344181a1cadd65c2d2dcc3'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.070608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b717-d8d4-4acf-b2f3-40a8596d82ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.077150 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.078465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.079090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.079588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] PATH_INFO: `/v3/projects/147af77ead57444b991a4aef5577b680` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.081322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147af77ead57444b991a4aef5577b680)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.084897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.113824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf19c9a86344181a1cadd65c2d2dcc3'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.122324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf19c9a86344181a1cadd65c2d2dcc3'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.133691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-77609487-7076-41d9-9ad4-d34b8d24cc7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf19c9a86344181a1cadd65c2d2dcc3'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.139876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1200/2418] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:05 2022] DELETE /identity/v3/users/2bf19c9a86344181a1cadd65c2d2dcc3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:06.189029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147af77ead57444b991a4aef5577b680', 'request_id': 'req-a2801a82-8bcb-4203-8cea-1afcc685a3e1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.268092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147af77ead57444b991a4aef5577b680', 'request_id': 'req-a2801a82-8bcb-4203-8cea-1afcc685a3e1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.273844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147af77ead57444b991a4aef5577b680', 'request_id': 'req-a2801a82-8bcb-4203-8cea-1afcc685a3e1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.285524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] The token cache is being invalidate because project 147af77ead57444b991a4aef5577b680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:06.285750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.286395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a2801a82-8bcb-4203-8cea-1afcc685a3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.287959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1219/2419] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:06 2022] DELETE /identity/v3/projects/147af77ead57444b991a4aef5577b680 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:06.293065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.293425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.293777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.312568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:06.313832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.373501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1201/2420] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:06.381309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.381850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.381850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.400310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:06.401643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.410672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1220/2421] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:06.415082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.425659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb377e-a867-4ea2-bf0d-56a288283ac6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.430667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.431316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.431596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.431902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.432666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:06.432965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.434555 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.449597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1202/2422] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:32:06.451015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.460804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c959f-3034-4ffa-85ed-0d967602c7d4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.465554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.466200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.466481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.466753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.468023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.469967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.547427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.549199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.562465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c0f7-929d-4fab-93fb-a8e601a09d4c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.568040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.568953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.569595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.569876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] PATH_INFO: `/v3/projects/275e4ca81d1248ba98718d775404a8c4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.571489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=275e4ca81d1248ba98718d775404a8c4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.572613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1221/2423] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:06.577449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.577569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.642972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8486-a72f-4fbb-a5c1-be7f78e48827 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.648254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.649019 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.649322 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.649623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.650304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.652273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.679522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275e4ca81d1248ba98718d775404a8c4', 'request_id': 'req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.689329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275e4ca81d1248ba98718d775404a8c4', 'request_id': 'req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.695335 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275e4ca81d1248ba98718d775404a8c4', 'request_id': 'req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.763644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1222/2424] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:06.768060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.782155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06b710-ebe4-485a-8bf9-7e172ab1f554 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.784683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] The token cache is being invalidate because project 275e4ca81d1248ba98718d775404a8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:06.785892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.787307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e1cb86e7-2ba3-4adc-8879-5ec9790fe0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:06.790112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1203/2425] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:06 2022] DELETE /identity/v3/projects/275e4ca81d1248ba98718d775404a8c4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:06.795950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d29-e4fc-424f-8bca-b453a41e5797 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.796848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d29-e4fc-424f-8bca-b453a41e5797 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.798596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4d29-e4fc-424f-8bca-b453a41e5797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.821525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-623b4d29-e4fc-424f-8bca-b453a41e5797 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:06.823092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-623b4d29-e4fc-424f-8bca-b453a41e5797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.875001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.875679 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.876586 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.877057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.878439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.879992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.893750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1223/2426] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:06.897474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.899511 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.912332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176356f6-a110-4a90-8970-d76520cfe9e2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.918161 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1204/2427] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:06.918333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.919066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.919444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.919816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.920724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.922678 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.926480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.926766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.927042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.937646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1224/2428] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:06.938778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.946574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:06.947816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:06.950226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef940a-fd7d-4e84-b16e-a7a8da780c94 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.956158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.959974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.960101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1205/2429] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:06.960193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.960193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] PATH_INFO: `/v3/projects/f8997eb02dd8487f8cff5d5261a61c2c/users/13ee9671955c46ea8d8a3e62f3ea9ac7/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.960961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:06.969847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed18bbc-308a-4800-85fd-59b095258a7e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:06.976658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:06.977464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:06.977744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:06.978015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:06.978198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8997eb02dd8487f8cff5d5261a61c2c, user_id=13ee9671955c46ea8d8a3e62f3ea9ac7, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.978763 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:06.979048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:06.980626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.981546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cda933-40c4-451d-93f7-a943a4b8c73d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:06.992352 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1206/2430] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:07.003604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.013540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e70a-2a25-44ad-90a4-de3001cfcdc8 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.018859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.019507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.019787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.020073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.020794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.022683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.053000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1225/2431] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:06 2022] PUT /identity/v3/projects/f8997eb02dd8487f8cff5d5261a61c2c/users/13ee9671955c46ea8d8a3e62f3ea9ac7/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:07.064608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.064896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.065166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.091737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] MFA Rules not processed for user `13ee9671955c46ea8d8a3e62f3ea9ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:07.094044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:07.133305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1207/2432] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:07.138503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.166353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1226/2433] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:07.177811 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.178738 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:07.205257 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404dc68-922d-4a3a-a64a-76c097ee0540 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.212145 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.213128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.213413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.213689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.214383 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.216474 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.241645 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fe225-cbbe-4c4b-8b7a-0958a04e67f3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.291399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.292079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.301632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.301632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.328514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1208/2434] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:07.335635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.345330 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f8bc-89a0-431f-b3ee-1e5c2580b01b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.348882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.349695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.350167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.350582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.351541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.353253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.358057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.359898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.369390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1209/2435] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:07.369591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1227/2436] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:07.370812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.381724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0c4d-eecf-41ed-bb9c-cfec8cf4682d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.388001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.388750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.389609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.389889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.391148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.394026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecee145-6eff-4b06-93e0-384e1210a952 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.409113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1210/2437] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:07.413453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.424994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381373e-496e-4ef0-8087-c64e0eaef372 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.430370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.431352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.431627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.431901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] PATH_INFO: `/v3/projects/48d8f461635f4a3084c1d8afb24acf93/users/93f96c52c8114e3991da597650a14293/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.448412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d8f461635f4a3084c1d8afb24acf93, user_id=93f96c52c8114e3991da597650a14293, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.452607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.550297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1228/2438] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:07 2022] PUT /identity/v3/projects/48d8f461635f4a3084c1d8afb24acf93/users/93f96c52c8114e3991da597650a14293/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:07.560266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.561248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.561568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.591681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] MFA Rules not processed for user `93f96c52c8114e3991da597650a14293`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:07.593117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:07.683275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1211/2439] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:07.687840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.820915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9906084-ca24-4e1b-84c5-1178b951ddc2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:07.830558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:07.832180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:07.832499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:07.833529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:07.834416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:07.836687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:07.922977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1229/2440] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:07.931587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:07.941524 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69d0c-cc49-41a1-90d7-f0bd07f48387 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.138059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.138896 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.139239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.139580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.140347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.142477 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.264196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1212/2441] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:07 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:08.267822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:08.278021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e48a-afa1-4c19-8b07-2c983642c3df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.284827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.285467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.286204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.286204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.287946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.289498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.309145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1230/2442] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:08.314748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:08.325498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f1da-9890-4199-a14f-bf7141a94633 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.335465 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.336853 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.337227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.337616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] PATH_INFO: `/v3/projects/61246e8e193d4de082b04fddf6f8d212/users/207084a1cb144166be65af18ae101eab/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.360545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61246e8e193d4de082b04fddf6f8d212, user_id=207084a1cb144166be65af18ae101eab, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.363320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.462218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1213/2443] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:08 2022] PUT /identity/v3/projects/61246e8e193d4de082b04fddf6f8d212/users/207084a1cb144166be65af18ae101eab/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:08.466553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:08.479482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6aa25-4912-4a04-aa28-b41844f3388b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.540276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.540994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.541277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.541554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.542276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.543879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f58b2-e3ba-475f-a83a-f888ae41bfd3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.557583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1231/2444] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:08.558793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:08.570571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab00f-3c7c-4468-a344-bcc9ed00dcc6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.579227 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.580399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.580966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.581932 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] PATH_INFO: `/v3/projects/61246e8e193d4de082b04fddf6f8d212/users/207084a1cb144166be65af18ae101eab/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.595343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61246e8e193d4de082b04fddf6f8d212, user_id=207084a1cb144166be65af18ae101eab, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.599314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.634743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1214/2445] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:08 2022] PUT /identity/v3/projects/61246e8e193d4de082b04fddf6f8d212/users/207084a1cb144166be65af18ae101eab/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:08.635964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.636255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.636618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.697089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] MFA Rules not processed for user `207084a1cb144166be65af18ae101eab`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:08.698497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:08.817667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1232/2446] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:08.833717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:08.835453 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:08.919910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354c2c-bf83-4c46-8f13-0ab8b923f71c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:08.938413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:08.940262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:08.941014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:08.941557 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:08.956850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:08.958451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397524a-d717-4e70-b328-72d374927714 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:08.970324 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1215/2447] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:10.011349 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:10.078497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5189927-d46d-4e1c-88ce-e842c9848a5b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:10.083475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:10.084331 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:10.084660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:10.084932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] PATH_INFO: `/v3/users/93f96c52c8114e3991da597650a14293` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:10.086273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f96c52c8114e3991da597650a14293)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:10.088165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:10.265074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f96c52c8114e3991da597650a14293'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:10.265744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f96c52c8114e3991da597650a14293'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:10.272981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f96c52c8114e3991da597650a14293'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:10.336481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f96c52c8114e3991da597650a14293'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:10.349986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f96c52c8114e3991da597650a14293'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:10.356109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1233/2448] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:10 2022] DELETE /identity/v3/users/93f96c52c8114e3991da597650a14293 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:10.360657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:10.361131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:10.363126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:10.377942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:10.379115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:10.444407 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1216/2449] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:10.452529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:10.455670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:10.512593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9f61-3373-4dd2-a0a5-8ede8ecc854e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:10.516725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:10.517369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:10.517649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:10.517927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:10.527220 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:10.528691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:10.539143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1234/2450] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:10.984319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:10.986150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:11.002089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeffbf-8192-40aa-b1ca-7f9bdeda7376 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:11.009241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:11.010342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:11.010749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:11.011028 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] PATH_INFO: `/v3/projects/48d8f461635f4a3084c1d8afb24acf93` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:11.012891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d8f461635f4a3084c1d8afb24acf93)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:11.015268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:11.137067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d8f461635f4a3084c1d8afb24acf93', 'request_id': 'req-d01c58cf-2e66-430e-b820-f882f550ed35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.143768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d8f461635f4a3084c1d8afb24acf93', 'request_id': 'req-d01c58cf-2e66-430e-b820-f882f550ed35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.150574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d8f461635f4a3084c1d8afb24acf93', 'request_id': 'req-d01c58cf-2e66-430e-b820-f882f550ed35'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.234292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] The token cache is being invalidate because project 48d8f461635f4a3084c1d8afb24acf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:11.234686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.235391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.236989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1217/2451] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:10 2022] DELETE /identity/v3/projects/48d8f461635f4a3084c1d8afb24acf93 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:11.240962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:11.251476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafb608-ca47-49d5-a361-936e17fe5637 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:11.305840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:11.306769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:11.306998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:11.307277 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] PATH_INFO: `/v3/users/207084a1cb144166be65af18ae101eab` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:11.308467 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207084a1cb144166be65af18ae101eab)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:11.312258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:11.532766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207084a1cb144166be65af18ae101eab'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.533434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207084a1cb144166be65af18ae101eab'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.539918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207084a1cb144166be65af18ae101eab'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.610987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207084a1cb144166be65af18ae101eab'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.625993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-543170a0-35a8-4899-a2d1-134de70f69f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207084a1cb144166be65af18ae101eab'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:11.638790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1235/2452] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:11 2022] DELETE /identity/v3/users/207084a1cb144166be65af18ae101eab => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:12.128702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.128702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:12.166077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c58cf-2e66-430e-b820-f882f550ed35 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.223972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.224878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.225183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.225458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] PATH_INFO: `/v3/projects/61246e8e193d4de082b04fddf6f8d212` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.226695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61246e8e193d4de082b04fddf6f8d212)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.228622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.335693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61246e8e193d4de082b04fddf6f8d212', 'request_id': 'req-6bd48e95-81bf-4e82-801c-1ac8b63b579c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:12.342067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61246e8e193d4de082b04fddf6f8d212', 'request_id': 'req-6bd48e95-81bf-4e82-801c-1ac8b63b579c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:12.347566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61246e8e193d4de082b04fddf6f8d212', 'request_id': 'req-6bd48e95-81bf-4e82-801c-1ac8b63b579c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:12.398159 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] The token cache is being invalidate because project 61246e8e193d4de082b04fddf6f8d212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:12.398375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:12.398971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6bd48e95-81bf-4e82-801c-1ac8b63b579c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:12.400537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1218/2453] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:12 2022] DELETE /identity/v3/projects/61246e8e193d4de082b04fddf6f8d212 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:12.405841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.406317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.406429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.424121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:12.429977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:12.483702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1236/2454] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:12.491807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.492297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.492601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.510822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:12.512017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:12.519705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1219/2455] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:12.523825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.533461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ea8f-ef87-441e-8eba-8a7b18f1d627 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.538278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.538932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.539218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.539495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.540219 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:12.540559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.542167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.554050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1237/2456] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:32:12.558293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.574914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a937f-7d15-44f1-9c9d-bd04ec06c6d6 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.574914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.574914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.574914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.575271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.575271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.576182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.681148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1220/2457] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:12 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:12.684882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.696278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e7e4-41cf-4238-9bdb-02abca6bdcd0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.764054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.764668 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.764954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.765253 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.765950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.768327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.848119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1238/2458] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:12 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:12.850167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.860880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d746e4-8ca6-4028-82a1-3cd7ccd4acc1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.865513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.866172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.868622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.868622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.868622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.869029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.879825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1221/2459] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:12.883897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.893920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432c33-f26b-45e9-a07d-821ec5a7b107 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.898830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.899593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.899939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.900290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.901190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.902907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82219c-5370-4534-bba7-64b18491124e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:12.916392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1239/2460] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:12.918446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:12.929435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a70052-24dd-459d-86cd-a99ce290f217 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:12.934287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:12.935835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:12.939228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:12.939843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] PATH_INFO: `/v3/projects/777b47a800394b9f9a448e4b511bd0e4/users/0be984844f2a453895396e315dcd2358/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:12.959342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] RBAC: Authorizing `identity:create_grant(project_id=777b47a800394b9f9a448e4b511bd0e4, user_id=0be984844f2a453895396e315dcd2358, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:12.962625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.068475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1222/2461] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:12 2022] PUT /identity/v3/projects/777b47a800394b9f9a448e4b511bd0e4/users/0be984844f2a453895396e315dcd2358/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:13.079021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.079312 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.079590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.106815 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] MFA Rules not processed for user `0be984844f2a453895396e315dcd2358`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:13.108059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:13.172867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1240/2462] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:13.177387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.240176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd98c-02a9-403d-8832-0246957742da admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.245253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.245915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.246219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.246470 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.247172 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.249106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.339956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1223/2463] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:13 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:13.341235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.358030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da00fa7-57df-4cb5-ad61-f85cd432c152 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.425755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.427237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.427518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.427791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.428538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.430681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.534962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1241/2464] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:13 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:13.535936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.546287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866517-10b5-474b-a8df-9cc035181155 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.551738 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.552759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.553209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.553730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.554462 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.556584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.568394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1224/2465] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:13.571510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.583958 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9853-4126-44b8-b4bc-ca0efa23e835 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.588795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.589450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.589740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.589998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.590712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.592429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f40f-a7e7-437f-99f6-41a538040297 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.603351 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1242/2466] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:13.607538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.617967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e1f9-0941-44e2-b274-a4b458a909ff admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.622717 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.623586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.623935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.624114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] PATH_INFO: `/v3/projects/8454e0a731cf400e9f93fcd2addd2777/users/81e89caf27c54cdc8324fa7ae0669ac4/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.641375 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8454e0a731cf400e9f93fcd2addd2777, user_id=81e89caf27c54cdc8324fa7ae0669ac4, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.644209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:13.776661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1225/2467] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:13 2022] PUT /identity/v3/projects/8454e0a731cf400e9f93fcd2addd2777/users/81e89caf27c54cdc8324fa7ae0669ac4/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:13.788534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.788854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.789132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.816071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] MFA Rules not processed for user `81e89caf27c54cdc8324fa7ae0669ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:13.817291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:13.878739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1243/2468] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:13.883250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:13.944564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9af0b5-552e-4f28-998e-22030bb846d4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:13.949639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:13.950342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:13.950639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:13.950917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:13.951594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:13.954072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.029852 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1226/2469] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:13 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:14.035986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.047488 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b3abe-29f5-41bc-9bb9-945cfde8473c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.087501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.089223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:14.107058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.110143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.110143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.110143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.110143 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.111423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.147786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f35df-091f-4ba0-a36e-af70534fd462 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.151567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.159265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.159265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.159265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.159265 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:14.167689 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.169284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.180091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1227/2470] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:14.197534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1244/2471] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:14 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:14.198002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.208719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a7c9-2232-4383-aae8-812f696eb03d service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.214828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.215502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.215782 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.216055 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.216834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.219037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.230002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1228/2472] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:14.235182 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.245270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264b30-ecc6-4e35-927c-5fa521aba20c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.250827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.251725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.252051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.252396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] PATH_INFO: `/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5/users/6c4e5a58e1724b21880accc979db66ae/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.268764 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be2a25eb2f4c41bf5e2d0e9a70cec5, user_id=6c4e5a58e1724b21880accc979db66ae, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.271414 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.332018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1245/2473] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:14 2022] PUT /identity/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5/users/6c4e5a58e1724b21880accc979db66ae/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:14.336254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.352067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f94d-e78d-43ee-8fe7-f9b81bec01eb admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.416144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.417042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.417537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.417820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.418552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.420282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129998b-082f-4f0a-86ee-838e15c05d74 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.432495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1229/2474] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:14.436731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.459085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889330f-a085-4921-86e8-530d67b3d8bd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.467132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.469633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.470320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.470803 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] PATH_INFO: `/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5/users/6c4e5a58e1724b21880accc979db66ae/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.474438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be2a25eb2f4c41bf5e2d0e9a70cec5, user_id=6c4e5a58e1724b21880accc979db66ae, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.477820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.491723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1246/2475] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:14 2022] PUT /identity/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5/users/6c4e5a58e1724b21880accc979db66ae/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:14.501967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.505205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.505205 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.534751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] MFA Rules not processed for user `6c4e5a58e1724b21880accc979db66ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:14.536700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:14.623735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1230/2476] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:14.629436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:14.631279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:14.711404 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e37bd-10ad-4e4e-a592-81695f2479c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:14.715782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:14.716507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:14.716788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:14.717227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:14.727832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:14.730317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ed4cd-711a-4301-a621-cf452450f4a0 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:14.744654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1247/2477] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:15.869479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:15.870903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:15.882549 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499bf50-6852-42bf-b2d5-d5fc1d0fca2a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:15.886444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:15.887108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:15.887387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:15.887659 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:15.943345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:15.945434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:15.954276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1231/2478] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:16.925796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:16.926272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:16.926375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:16.944665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:16.945854 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:17.007561 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1248/2479] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:32:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:17.035288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:17.036845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:17.114229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d92d8-8333-476e-ad8f-119b4cbccd94 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:17.119456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:17.120163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:17.120479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:17.121277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:17.130002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:17.131584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946354-ffbd-4892-815b-43c28f7004d9 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:17.139695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1232/2480] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:32:17.579005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:17.580475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:17.665163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e952a6-df02-4389-aa07-cbc4600c4a4b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:17.673772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:17.674669 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:17.674944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:17.675257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] PATH_INFO: `/v3/users/13ee9671955c46ea8d8a3e62f3ea9ac7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:17.676520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ee9671955c46ea8d8a3e62f3ea9ac7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:17.678454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:17.915830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ee9671955c46ea8d8a3e62f3ea9ac7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:17.916537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ee9671955c46ea8d8a3e62f3ea9ac7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:17.924450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ee9671955c46ea8d8a3e62f3ea9ac7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:17.988095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ee9671955c46ea8d8a3e62f3ea9ac7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.003265 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ee9671955c46ea8d8a3e62f3ea9ac7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.009341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1249/2481] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:17 2022] DELETE /identity/v3/users/13ee9671955c46ea8d8a3e62f3ea9ac7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:18.013848 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:18.014371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:18.014672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:18.033104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:18.034276 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:18.051638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:18.053694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:18.102331 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1233/2482] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:18.112390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:18.113978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:18.152045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53fd6-72dd-4d99-8be5-1586a8e5329b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:18.157057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:18.158008 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:18.159184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:18.159184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] PATH_INFO: `/v3/users/6872824c64934fbba7a3863f30f2fde0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:18.160275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6872824c64934fbba7a3863f30f2fde0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:18.162842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:18.182760 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e58573-df14-47a3-b855-434b27de3e1d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:18.188072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:18.188799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:18.189080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:18.189351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:18.199299 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:18.200811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:18.211660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1234/2483] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:18.366806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6872824c64934fbba7a3863f30f2fde0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.367527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6872824c64934fbba7a3863f30f2fde0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.378115 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6872824c64934fbba7a3863f30f2fde0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.434009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6872824c64934fbba7a3863f30f2fde0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.447311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6872824c64934fbba7a3863f30f2fde0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.453304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1250/2484] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:18 2022] DELETE /identity/v3/users/6872824c64934fbba7a3863f30f2fde0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:18.713379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:18.725326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4625-dca8-416a-a5c0-a24d9dc77940 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:18.783943 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:18.784840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:18.785120 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:18.785412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] PATH_INFO: `/v3/projects/5c47e882a00247d791d25edbdb2fce54` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:18.786568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c47e882a00247d791d25edbdb2fce54)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:18.788478 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:18.792627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:18.794380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:18.811540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50394b2-f79f-4cb6-ac21-5e055e4c6561 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:18.820787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:18.821930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:18.822317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:18.823156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] PATH_INFO: `/v3/projects/f8997eb02dd8487f8cff5d5261a61c2c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:18.824691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8997eb02dd8487f8cff5d5261a61c2c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:18.831955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:18.913515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c47e882a00247d791d25edbdb2fce54', 'request_id': 'req-6624640f-474f-4856-8a03-fc2ccee46ddc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.919847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c47e882a00247d791d25edbdb2fce54', 'request_id': 'req-6624640f-474f-4856-8a03-fc2ccee46ddc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.926648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c47e882a00247d791d25edbdb2fce54', 'request_id': 'req-6624640f-474f-4856-8a03-fc2ccee46ddc'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:18.942916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8997eb02dd8487f8cff5d5261a61c2c', 'request_id': 'req-f73bbb7d-49cf-4301-9821-788faee6867d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.017113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] The token cache is being invalidate because project 5c47e882a00247d791d25edbdb2fce54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:19.017511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.020132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6624640f-474f-4856-8a03-fc2ccee46ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.020132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1235/2485] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:18 2022] DELETE /identity/v3/projects/5c47e882a00247d791d25edbdb2fce54 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:19.024277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4c1c-d3b4-4843-aba2-7047e30f2957 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.024593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4c1c-d3b4-4843-aba2-7047e30f2957 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.024863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4c1c-d3b4-4843-aba2-7047e30f2957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.042735 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-56bc4c1c-d3b4-4843-aba2-7047e30f2957 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:19.043910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-56bc4c1c-d3b4-4843-aba2-7047e30f2957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:19.067629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8997eb02dd8487f8cff5d5261a61c2c', 'request_id': 'req-f73bbb7d-49cf-4301-9821-788faee6867d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.073796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8997eb02dd8487f8cff5d5261a61c2c', 'request_id': 'req-f73bbb7d-49cf-4301-9821-788faee6867d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.086050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] The token cache is being invalidate because project f8997eb02dd8487f8cff5d5261a61c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:19.086337 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.086983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f73bbb7d-49cf-4301-9821-788faee6867d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:19.088775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1251/2486] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:18 2022] DELETE /identity/v3/projects/f8997eb02dd8487f8cff5d5261a61c2c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:19.093865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1dda-bc25-45f4-a2ca-c5994498e009 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.094147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1dda-bc25-45f4-a2ca-c5994498e009 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.094419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1dda-bc25-45f4-a2ca-c5994498e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.105327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1236/2487] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:19.114123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.114457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.114730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.115222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6faa1dda-bc25-45f4-a2ca-c5994498e009 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:19.116623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6faa1dda-bc25-45f4-a2ca-c5994498e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:19.125270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1252/2488] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:19.132915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.133325 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.134144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.135398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:19.136677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:19.148194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1237/2489] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:19.151946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.154199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:19.155465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:19.162416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901e34-ce2d-4f49-94d2-21fb6968da58 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.171469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1253/2490] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:19.175725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.182575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.183506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.183891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.184225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.186397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:19.186800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.187978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e9424-cd9d-40f0-bedf-bb3cf1cdd76a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.190544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.194208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.194967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.195319 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.195780 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.196616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:19.197010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.198895 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.208532 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1238/2491] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:19.210857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.214468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1254/2492] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:19.220896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.223651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26dca2-a053-4d32-82a9-e3d9f6384e48 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.229150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.230229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.230514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.230786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.231469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.233922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.235983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25eee-0d12-4345-9284-a2721711c620 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.240917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.241794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.242170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.242536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.243313 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.245559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.326572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1239/2493] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:19.331041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.387637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1255/2494] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:19.390969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a9785-66d2-45b3-a7d4-2c661f0e4975 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.392480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.460804 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.461686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.462072 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.462749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.463608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.466064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.471950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42cd31-93cd-4351-8a71-627905fda5b7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.491791 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.495192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.496352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.497572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.499133 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.501994 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.795894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1240/2495] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/users => generated 294 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:19.798983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.808476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b3f8f-5e5d-4f8b-8acc-79341875e7e2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.813448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.814109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.814387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.814660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.816083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.817823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.826022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1256/2496] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:19 2022] POST /identity/v3/users => generated 288 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:19.828846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1241/2497] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:19.830786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.833031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.842384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc42ff-38e6-4e95-b6b1-c0b173c010f3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.842634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca25d83-12fe-4d64-8312-42c7a4cad0a2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.847336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.847623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.848128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.848279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.848445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.848722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.848862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.849109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.849433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.850148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.851056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.851726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.862171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1242/2498] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:19.865526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1257/2499] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:19.867207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.867360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.877632 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce520fe-f163-4824-9071-a3cb595c4960 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.877826 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbba38-bd42-4b98-91a3-40ae61c7413d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.882293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.882469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.883081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.883214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.883355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.883470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.883627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.883744 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] PATH_INFO: `/v3/projects/a97062b81a464349855b5b93da0235e0/users/b6c4dafebeb14c7085ff3fd1ed8e70bc/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.884390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.885998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.896904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1243/2500] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:19.901098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:19.902172 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97062b81a464349855b5b93da0235e0, user_id=b6c4dafebeb14c7085ff3fd1ed8e70bc, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.905071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98ffc8-50eb-4ddc-9e37-414f2231edff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:19.911207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667a47-2b47-4bbb-b958-5574ec1dd21e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:19.916390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:19.917268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:19.917545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:19.917817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] PATH_INFO: `/v3/projects/42fad05dd5ad4a0889cd918f4a7db722/users/e3bc665858d0488c988c682538dd59f9/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:19.935088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fad05dd5ad4a0889cd918f4a7db722, user_id=e3bc665858d0488c988c682538dd59f9, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:19.938509 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21095769-e0a7-4ece-9a03-f1f6ab1665d3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.010978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1258/2501] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:19 2022] PUT /identity/v3/projects/a97062b81a464349855b5b93da0235e0/users/b6c4dafebeb14c7085ff3fd1ed8e70bc/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:20.022554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.023101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.023369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.041179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1244/2502] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:19 2022] PUT /identity/v3/projects/42fad05dd5ad4a0889cd918f4a7db722/users/e3bc665858d0488c988c682538dd59f9/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:20.052155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.052591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.052936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.080844 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] MFA Rules not processed for user `b6c4dafebeb14c7085ff3fd1ed8e70bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:20.082054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:20.096292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] MFA Rules not processed for user `e3bc665858d0488c988c682538dd59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:20.097452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:20.177863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1259/2503] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:20.182264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.185683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1245/2504] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:20.198367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.203075 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:20.289802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021e77-c850-42e9-b007-f17e08a1af8a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.297140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.297851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.298128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.298399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.299399 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.301542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.306258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9892ad-f95c-4645-b7f8-f9235e77b881 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.313905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.314889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.315389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.315865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.324568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.326150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.335426 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1246/2505] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:20.419209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.422876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1260/2506] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:20.433277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a160-56b3-4d5a-9ea9-f8e94e03002b service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.540174 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.541142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.541515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.541884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.542077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.542893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.545095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.559723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b7ee2-c00d-4373-a0a4-244c4d7e5af3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.570881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.570881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.570881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.570881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] PATH_INFO: `/v3/users/e3bc665858d0488c988c682538dd59f9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.571375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3bc665858d0488c988c682538dd59f9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.571375 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.644444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1247/2507] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:20 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:20.650354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.662746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a08a42-c397-44fb-93db-f4fbbe8c69a5 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.668016 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.668845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.669319 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.669666 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.670454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.676865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.691178 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1248/2508] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:20.692274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.703056 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180ada-dbd7-41f2-b176-a47cdaf83e7f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:20.708749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:20.714076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.714076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.714076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] PATH_INFO: `/v3/projects/acabfc151141452a9a89eabdc098e685/users/c2e2ea05c7394274b89185c881f028f0/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.727332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acabfc151141452a9a89eabdc098e685, user_id=c2e2ea05c7394274b89185c881f028f0, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:20.730133 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:20.775966 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3bc665858d0488c988c682538dd59f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:20.776644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3bc665858d0488c988c682538dd59f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:20.783204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3bc665858d0488c988c682538dd59f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:20.880295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1249/2509] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:20 2022] PUT /identity/v3/projects/acabfc151141452a9a89eabdc098e685/users/c2e2ea05c7394274b89185c881f028f0/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:20.884262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:20.885881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:20.902097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3bc665858d0488c988c682538dd59f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:20.915320 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-857887eb-c236-4100-8cbd-57a19f4189b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3bc665858d0488c988c682538dd59f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:20.922822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1261/2510] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:20 2022] DELETE /identity/v3/users/e3bc665858d0488c988c682538dd59f9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:20.926736 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:20.927023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:20.927305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:20.944851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:20.946149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:20.954586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1549be-f315-49f4-b616-4ab0cf2f704d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.022062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.022677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.022813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1262/2511] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:21.022959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.023233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.024012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.025636 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.034640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.043977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1250/2512] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:21.043977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.045195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.052831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad344-d8dd-4c3a-80da-3a20e0be570f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.057387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.059728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.062843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.063147 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] PATH_INFO: `/v3/projects/acabfc151141452a9a89eabdc098e685/users/c2e2ea05c7394274b89185c881f028f0/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.065455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acabfc151141452a9a89eabdc098e685, user_id=c2e2ea05c7394274b89185c881f028f0, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.068098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eff7-69a0-4be8-8dfc-01ccac4caa67 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.079685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1251/2513] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:21 2022] PUT /identity/v3/projects/acabfc151141452a9a89eabdc098e685/users/c2e2ea05c7394274b89185c881f028f0/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:21.090349 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.090634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.090915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.121185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] MFA Rules not processed for user `c2e2ea05c7394274b89185c881f028f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:21.122542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.127628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d980-da2f-4976-94f7-ea4d34c32e04 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.209474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.210287 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.210629 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.210912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.225217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1252/2514] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:21.239203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.240849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.289963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.291367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.303944 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1263/2515] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:21.308393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f6fd-75a5-4824-94e4-93d8baf0382f None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.312087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.312754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.313035 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.313304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.322386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.323812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.333300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1253/2516] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:21.361611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.371022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af183c-d4ea-4bb6-ba49-7fc787f7739f service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.375810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.384091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.384091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.384091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] PATH_INFO: `/v3/users/b6c4dafebeb14c7085ff3fd1ed8e70bc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.384091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c4dafebeb14c7085ff3fd1ed8e70bc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.384091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.391737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.401466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f948-f994-41c7-92f3-eaa4bdbb3827 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.405840 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.407036 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.407631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.407631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.409577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.469652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.471037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8efe44-e498-4790-b6e2-c2b06bf08b1f service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.480005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1254/2517] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:21.625303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c4dafebeb14c7085ff3fd1ed8e70bc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:21.626691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c4dafebeb14c7085ff3fd1ed8e70bc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:21.651074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c4dafebeb14c7085ff3fd1ed8e70bc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:21.753969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c4dafebeb14c7085ff3fd1ed8e70bc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:21.776579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c4dafebeb14c7085ff3fd1ed8e70bc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:21.783316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1264/2518] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:21 2022] DELETE /identity/v3/users/b6c4dafebeb14c7085ff3fd1ed8e70bc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:21.788546 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.790892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.790892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.818343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:21.819566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.892410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1255/2519] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:21.901487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.902926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.920879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:21.925649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:21.951501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9033c-8e3a-49f4-bdb9-8374679e5992 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.959360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.960294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.960834 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.961116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] PATH_INFO: `/v3/projects/42fad05dd5ad4a0889cd918f4a7db722` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:21.963283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fad05dd5ad4a0889cd918f4a7db722)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:21.966875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:21.990229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193e1e-7680-4626-b715-426112322c09 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:21.994798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:21.995820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:21.995820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:21.996050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.017290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.020052 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f571-9161-4fbb-927f-9ded79896dfd service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.030939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1265/2520] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:22.112093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fad05dd5ad4a0889cd918f4a7db722', 'request_id': 'req-a83783bc-4f92-47d7-87bb-836f8419ba9c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.130511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fad05dd5ad4a0889cd918f4a7db722', 'request_id': 'req-a83783bc-4f92-47d7-87bb-836f8419ba9c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.144799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fad05dd5ad4a0889cd918f4a7db722', 'request_id': 'req-a83783bc-4f92-47d7-87bb-836f8419ba9c'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.248050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] The token cache is being invalidate because project 42fad05dd5ad4a0889cd918f4a7db722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:22.249973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.250631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a83783bc-4f92-47d7-87bb-836f8419ba9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.252780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1256/2521] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:21 2022] DELETE /identity/v3/projects/42fad05dd5ad4a0889cd918f4a7db722 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:22.257694 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.258185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.258284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.280202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:22.284545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:22.384084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1266/2522] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:22.392020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.392310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.392642 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.411167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:22.412316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:22.420611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1257/2523] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:22.425478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.435326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c9f9-249a-4f87-b40a-3541a472e18d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.440534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.441180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.441456 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.441723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.442498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:22.442793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.444421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.455772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1267/2524] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:22.461146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.469944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91c0ee-633a-47f9-a50e-4eabd6af337b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.474553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.475220 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.475494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.475762 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.476541 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.478485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.515482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.518665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:22.536741 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92dc1-80eb-4f6d-893c-6881d9218d1a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.542148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.542933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.543186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.543462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] PATH_INFO: `/v3/projects/a97062b81a464349855b5b93da0235e0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.544742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97062b81a464349855b5b93da0235e0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.547247 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.603816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1258/2525] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:22 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:22.605094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.682082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca55a4a-2d85-4240-a6cd-357ad4f075d6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.689007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.689756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.690039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.690314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.691678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.694073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.729571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97062b81a464349855b5b93da0235e0', 'request_id': 'req-c9d10f05-de12-4587-8be0-21b1826f22f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.852953 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97062b81a464349855b5b93da0235e0', 'request_id': 'req-c9d10f05-de12-4587-8be0-21b1826f22f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.856787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1259/2526] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:22 2022] POST /identity/v3/users => generated 303 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:22.867687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97062b81a464349855b5b93da0235e0', 'request_id': 'req-c9d10f05-de12-4587-8be0-21b1826f22f3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.868093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.874722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871273eb-0473-4b97-b5fd-85f1c5633b94 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.874915 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] The token cache is being invalidate because project a97062b81a464349855b5b93da0235e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:22.875126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.875826 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:22.880725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1268/2527] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:22 2022] DELETE /identity/v3/projects/a97062b81a464349855b5b93da0235e0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:22.881592 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.883297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:22.942620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.943293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.943568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.943839 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.944600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.950607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.956237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10f05-de12-4587-8be0-21b1826f22f3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.960621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1260/2528] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:22.961501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.961728 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:22.962376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.962657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.962964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] PATH_INFO: `/v3/users/c2e2ea05c7394274b89185c881f028f0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.963668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:22.964457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e2ea05c7394274b89185c881f028f0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.966248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:22.979768 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f84390-a0ca-4650-9299-eba30de0472e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:22.985051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:22.985722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:22.986185 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:22.986540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:22.987251 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:22.988898 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:23.002622 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1261/2529] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:23.008155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:23.013955 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cc3f-c436-4859-8f63-ffabf4420138 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:23.020047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:23.021082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:23.021430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:23.021777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] PATH_INFO: `/v3/projects/ff695082c1cb48b0b4e58a59f89dd401/users/bac4a42613ec48dd8ab55bcda46ed1a7/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:23.037125 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff695082c1cb48b0b4e58a59f89dd401, user_id=bac4a42613ec48dd8ab55bcda46ed1a7, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:23.039870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421f239-6da7-48f5-9dd6-9a1c4bbe6d01 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:23.139262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1262/2530] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:23 2022] PUT /identity/v3/projects/ff695082c1cb48b0b4e58a59f89dd401/users/bac4a42613ec48dd8ab55bcda46ed1a7/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:23.144708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:23.145074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:23.145427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:23.168779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e2ea05c7394274b89185c881f028f0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:23.169512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e2ea05c7394274b89185c881f028f0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:23.173673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:23.177949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:23.178162 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e2ea05c7394274b89185c881f028f0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:23.252411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1263/2531] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:23.259648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:23.261054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:23.267813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e2ea05c7394274b89185c881f028f0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:23.283338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e2ea05c7394274b89185c881f028f0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:23.290558 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1269/2532] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:22 2022] DELETE /identity/v3/users/c2e2ea05c7394274b89185c881f028f0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:23.337899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fda22-f022-4fff-88e4-5a77929e88a3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:23.391434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:23.392828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:23.392828 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:23.393043 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:23.459940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:23.461449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ea4a-67d9-4b5f-800f-c03bc19ec84e service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:23.470965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1264/2533] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:23.772999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:23.774869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:23.788900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5718a07-198b-42a1-a6d2-819239fe6d7f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:23.793560 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:23.794461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:23.794742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:23.795018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] PATH_INFO: `/v3/projects/acabfc151141452a9a89eabdc098e685` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:23.797024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=acabfc151141452a9a89eabdc098e685)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:23.798946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:23.932594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acabfc151141452a9a89eabdc098e685', 'request_id': 'req-0f063408-835c-4fad-99db-a4660ef6c8ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:24.034536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acabfc151141452a9a89eabdc098e685', 'request_id': 'req-0f063408-835c-4fad-99db-a4660ef6c8ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:24.045635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acabfc151141452a9a89eabdc098e685', 'request_id': 'req-0f063408-835c-4fad-99db-a4660ef6c8ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:24.059466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] The token cache is being invalidate because project acabfc151141452a9a89eabdc098e685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:24.060042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:24.060951 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0f063408-835c-4fad-99db-a4660ef6c8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:24.063623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1270/2534] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:23 2022] DELETE /identity/v3/projects/acabfc151141452a9a89eabdc098e685 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:24.069931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.070766 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.071683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.094070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:24.095398 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:24.204657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1265/2535] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:24.225950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.226257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.226536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.245623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:24.246827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:24.255328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1271/2536] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:24.259634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.271008 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef647b4-670e-4eb0-b616-41d9ffea27da None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.277731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.278560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.278920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.279358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.280926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:24.281313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.283724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.301503 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1266/2537] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:32:24.306345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.318229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cd028-5bd9-48fb-809d-625767c2e86b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.324551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.325266 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.325647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.326093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.326861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.329576 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.450011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1272/2538] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:24 2022] POST /identity/v3/projects => generated 407 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:24.451479 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.462773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5edd-2275-4460-b956-be053f25348f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.539878 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.540599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.540885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.541163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.541859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.543810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.619199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1267/2539] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:24 2022] POST /identity/v3/users => generated 304 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:24.622955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.637323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67610c7-b5b3-4d67-bcc6-7264704f304b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.668983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.669701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.669986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.670264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.671026 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.674105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.699194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1273/2540] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:24.702057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.717315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56d3f-d395-48c6-aa3f-8ae591a88269 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.722658 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.723912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.723912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.724269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.724798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.726534 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cee54-6024-450d-ab2f-8b18b301e5fc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.743273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1268/2541] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:24.747527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:24.758865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27a3a-6b7b-468d-987a-e5c2655b005c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:24.763750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:24.764737 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.765134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.765471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] PATH_INFO: `/v3/projects/011a84a950e44622885840639b673047/users/bbd8db1b47fb4a88b9f45cf1a3d370b2/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.780278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011a84a950e44622885840639b673047, user_id=bbd8db1b47fb4a88b9f45cf1a3d370b2, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:24.783574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efb6b-004d-43e6-920a-ade491fc0fc1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:24.898682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1274/2542] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:24 2022] PUT /identity/v3/projects/011a84a950e44622885840639b673047/users/bbd8db1b47fb4a88b9f45cf1a3d370b2/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:24.909485 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:24.910048 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:24.910428 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:24.960720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] MFA Rules not processed for user `bbd8db1b47fb4a88b9f45cf1a3d370b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:24.963275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:25.034620 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.035301 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.035753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.062525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1269/2543] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:25.063654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.070778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] MFA Rules not processed for user `bac4a42613ec48dd8ab55bcda46ed1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:25.072202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:25.151571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61590b-12a0-4e0e-bf4f-ec87e154ea61 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.164530 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.165803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.166350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.166774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.167631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.169845 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.189590 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1275/2544] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:25.194241 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.196662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:25.212296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72df0-e365-494b-b7ad-88cb12ea924f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.217869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.219756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.220090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.220315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.221121 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.223211 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.271158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1270/2545] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:25 2022] POST /identity/v3/projects => generated 409 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:25.272134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.329246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1276/2546] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:25 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:25.333704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.359146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9aa3-d567-482e-8f53-f9e9a0fc0660 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.413708 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e89a-5896-4781-8faf-11e6681b9223 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.418965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.419724 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.420515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.420947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.422029 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.424015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.426885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.427776 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.428061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.428398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.429091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.431045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.525802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1277/2547] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:25 2022] POST /identity/v3/users => generated 309 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:25.526198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1271/2548] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:25 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:25.530128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.532328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.542475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6b62-58b8-4973-a350-b0e023456602 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.542681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27ff6d-536f-46d8-a483-3c35ff8e0242 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.547478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.547726 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.548073 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.548348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.548606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.548718 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.549003 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.549335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.549487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.550296 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.550910 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.551965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.561221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1278/2549] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:25.565618 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1272/2550] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:25.566042 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.569671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.578292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad286-0834-4f2a-ab72-5aa5edb82f40 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.579790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2595-5a5c-4238-8d01-eb040f8e88f3 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.583138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.584072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.584453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.584580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.584727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] PATH_INFO: `/v3/projects/a33fb97953a34430ab19c2884431bc67/users/0b397621e94140ef96bff9a88aeb3a8d/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.585410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.585690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.585958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] PATH_INFO: `/v3/projects/b0851014d2cf41f2ac8d44964d44478d/users/bfbf51c7b0b84ba0863af6cfcd184b1f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.611444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb97953a34430ab19c2884431bc67, user_id=0b397621e94140ef96bff9a88aeb3a8d, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.614429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0851014d2cf41f2ac8d44964d44478d, user_id=bfbf51c7b0b84ba0863af6cfcd184b1f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.617725 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.626087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.727926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1273/2551] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:25 2022] PUT /identity/v3/projects/b0851014d2cf41f2ac8d44964d44478d/users/bfbf51c7b0b84ba0863af6cfcd184b1f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:25.731872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.737867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1279/2552] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:25 2022] PUT /identity/v3/projects/a33fb97953a34430ab19c2884431bc67/users/0b397621e94140ef96bff9a88aeb3a8d/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:25.741795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.842655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2bdb4-219d-48eb-b49d-dd5323dc8250 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.842908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0ce7-47dd-4e10-ad47-763b6649a428 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.847757 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.848469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.848626 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.848748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.849005 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.849973 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.850459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.850910 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.851602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.851801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.856094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.858283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.873535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1274/2553] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:25.881807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.885195 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1280/2554] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:25.886332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:25.888355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:25.895384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809f9e-e2fb-4db7-9f7a-1abe25e16015 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.901013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.902097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.902498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.902887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] PATH_INFO: `/v3/projects/b0851014d2cf41f2ac8d44964d44478d/users/bfbf51c7b0b84ba0863af6cfcd184b1f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.903543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b90c-032b-45be-9055-60202f058390 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:25.905192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0851014d2cf41f2ac8d44964d44478d, user_id=bfbf51c7b0b84ba0863af6cfcd184b1f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.908191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.908753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:25.909650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:25.909935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:25.910271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] PATH_INFO: `/v3/users/0be984844f2a453895396e315dcd2358` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:25.911927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be984844f2a453895396e315dcd2358)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:25.913954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:25.922813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1275/2555] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:25 2022] PUT /identity/v3/projects/b0851014d2cf41f2ac8d44964d44478d/users/bfbf51c7b0b84ba0863af6cfcd184b1f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:25.923707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:26.008070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce333-d04a-47f0-a459-75c7dc3f500e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:26.013321 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:26.016940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.016940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.016940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] PATH_INFO: `/v3/projects/a33fb97953a34430ab19c2884431bc67/users/0b397621e94140ef96bff9a88aeb3a8d/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.018204 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb97953a34430ab19c2884431bc67, user_id=0b397621e94140ef96bff9a88aeb3a8d, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:26.021106 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6701-8917-4127-b937-a91135e72daf admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:26.048083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1276/2556] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:25 2022] PUT /identity/v3/projects/a33fb97953a34430ab19c2884431bc67/users/0b397621e94140ef96bff9a88aeb3a8d/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:26.049849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.050146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.050427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.091786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] MFA Rules not processed for user `0b397621e94140ef96bff9a88aeb3a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:26.091786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:26.102656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be984844f2a453895396e315dcd2358'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:26.103749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be984844f2a453895396e315dcd2358'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:26.128058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be984844f2a453895396e315dcd2358'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:26.176794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1277/2557] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:26.187558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:26.187898 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be984844f2a453895396e315dcd2358'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:26.188950 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:26.200807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1d825ad-9ecd-4b43-94be-b9e72d4fe1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be984844f2a453895396e315dcd2358'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:26.207493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1281/2558] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:25 2022] DELETE /identity/v3/users/0be984844f2a453895396e315dcd2358 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:26.211887 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.212175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.212477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.230242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:26.231484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:26.259197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3250bdf-16e7-4fd7-bde0-7d3db70fcd45 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:26.295350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1282/2559] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:26.313750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:26.316591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:26.353664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:26.354345 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.354823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.354998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.442174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10c19b-80ea-403d-bf5d-6e8add1d2710 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:26.453444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:26.454114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.454388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.454663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.466924 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:26.468288 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:26.488868 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1283/2560] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:26.495171 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:26.499082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:26.515454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1278/2561] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:26.933687 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:26.947716 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9c2ba-824b-4f52-8957-c00e0787892e service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:26.951909 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:26.953045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:26.953512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:26.953947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:26.956057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.038903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:27.040768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:27.050940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1284/2562] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:27.201163 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:27.202620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.223074 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f53c-938b-413e-a411-e8a253e019ac service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:27.229217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:27.230039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:27.230313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:27.230601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] PATH_INFO: `/v3/projects/777b47a800394b9f9a448e4b511bd0e4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:27.231810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=777b47a800394b9f9a448e4b511bd0e4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:27.234416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:27.255547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:27.257431 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.274154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e92d4-361a-4554-b7da-df5f978caf05 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:27.279097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:27.279964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:27.280236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:27.281084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] PATH_INFO: `/v3/users/4b821add1bb64267813f3b3a1eba02ae` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:27.282262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b821add1bb64267813f3b3a1eba02ae)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:27.285932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:27.367533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777b47a800394b9f9a448e4b511bd0e4', 'request_id': 'req-70e60573-51a6-4269-a430-7200147ce6cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.373657 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777b47a800394b9f9a448e4b511bd0e4', 'request_id': 'req-70e60573-51a6-4269-a430-7200147ce6cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.379082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777b47a800394b9f9a448e4b511bd0e4', 'request_id': 'req-70e60573-51a6-4269-a430-7200147ce6cf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.456432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] The token cache is being invalidate because project 777b47a800394b9f9a448e4b511bd0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:27.457006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.459797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-70e60573-51a6-4269-a430-7200147ce6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.463314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1279/2563] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:27 2022] DELETE /identity/v3/projects/777b47a800394b9f9a448e4b511bd0e4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:27.467515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:27.467805 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:27.468660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:27.497352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b821add1bb64267813f3b3a1eba02ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.498366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b821add1bb64267813f3b3a1eba02ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.498497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] MFA Rules not processed for user `bfbf51c7b0b84ba0863af6cfcd184b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:27.499633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.506096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b821add1bb64267813f3b3a1eba02ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.568472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1280/2564] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:27.569315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:27.570619 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.587513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b821add1bb64267813f3b3a1eba02ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.601665 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b821add1bb64267813f3b3a1eba02ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.608335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1285/2565] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:27 2022] DELETE /identity/v3/users/4b821add1bb64267813f3b3a1eba02ae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:27.639590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee823e-d39b-49df-b728-a696cce6e3ed None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:27.704410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:27.705300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:27.705587 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:27.705864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] PATH_INFO: `/v3/users/81e89caf27c54cdc8324fa7ae0669ac4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:27.707228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e89caf27c54cdc8324fa7ae0669ac4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:27.709198 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:27.893378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:27.896380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:27.912853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c898c-28a8-41cf-960a-e4773a83874d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:27.918615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:27.919535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:27.919782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:27.920102 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] PATH_INFO: `/v3/projects/f7295e7b624c421095f925d2875434e6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:27.921914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7295e7b624c421095f925d2875434e6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:27.924328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:27.929132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e89caf27c54cdc8324fa7ae0669ac4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:27.929906 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e89caf27c54cdc8324fa7ae0669ac4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.011280 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e89caf27c54cdc8324fa7ae0669ac4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.019494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e89caf27c54cdc8324fa7ae0669ac4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.031079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e89caf27c54cdc8324fa7ae0669ac4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.037130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1281/2566] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:27 2022] DELETE /identity/v3/users/81e89caf27c54cdc8324fa7ae0669ac4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:28.073816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7295e7b624c421095f925d2875434e6', 'request_id': 'req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.130727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7295e7b624c421095f925d2875434e6', 'request_id': 'req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.137054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7295e7b624c421095f925d2875434e6', 'request_id': 'req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.149527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] The token cache is being invalidate because project f7295e7b624c421095f925d2875434e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:28.149818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.150489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.152514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1286/2567] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:27 2022] DELETE /identity/v3/projects/f7295e7b624c421095f925d2875434e6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:28.156182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:28.157775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:28.221423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1fff3-af9a-4cc1-95ad-ef881e08c993 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:28.277384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:28.278289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:28.286475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:28.286475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] PATH_INFO: `/v3/users/3f10909568ae4541bbd40490001c36ac` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:28.286475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f10909568ae4541bbd40490001c36ac)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:28.286475 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:28.452758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f10909568ae4541bbd40490001c36ac'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.453422 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f10909568ae4541bbd40490001c36ac'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.559160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f10909568ae4541bbd40490001c36ac'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.566535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f10909568ae4541bbd40490001c36ac'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.578151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f10909568ae4541bbd40490001c36ac'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.585325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1282/2568] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:28 2022] DELETE /identity/v3/users/3f10909568ae4541bbd40490001c36ac => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:28.649762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:28.651199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:28.669703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2962bf-9e46-4bd3-8e1b-ed24498a08e7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:28.741701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:28.742778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:28.743243 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:28.743525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] PATH_INFO: `/v3/projects/8454e0a731cf400e9f93fcd2addd2777` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:28.744746 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8454e0a731cf400e9f93fcd2addd2777)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:28.746870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:28.875674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8454e0a731cf400e9f93fcd2addd2777', 'request_id': 'req-82e59245-cb0d-4761-99ae-3d0c8f063b07'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.889680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:28.891686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:28.913289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469152-ed44-4c17-8124-1dcee7a306f9 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:28.942769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8454e0a731cf400e9f93fcd2addd2777', 'request_id': 'req-82e59245-cb0d-4761-99ae-3d0c8f063b07'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.954922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8454e0a731cf400e9f93fcd2addd2777', 'request_id': 'req-82e59245-cb0d-4761-99ae-3d0c8f063b07'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.966125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] The token cache is being invalidate because project 8454e0a731cf400e9f93fcd2addd2777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:28.966410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.967066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:28.969353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1287/2569] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:28 2022] DELETE /identity/v3/projects/8454e0a731cf400e9f93fcd2addd2777 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:28.973405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:28.977991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:28.979358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:28.980223 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:28.980605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:28.980881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] PATH_INFO: `/v3/projects/736d95a987d5459594dd5b1aea58a612` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:28.982054 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=736d95a987d5459594dd5b1aea58a612)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:28.983983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:28.987198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e59245-cb0d-4761-99ae-3d0c8f063b07 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:28.991969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:28.992946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:28.993227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:28.993497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] PATH_INFO: `/v3/users/6c4e5a58e1724b21880accc979db66ae` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:28.994842 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4e5a58e1724b21880accc979db66ae)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:28.996799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:29.101918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736d95a987d5459594dd5b1aea58a612', 'request_id': 'req-fcde61d4-761a-4011-978f-bef83d6504ad'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.107797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736d95a987d5459594dd5b1aea58a612', 'request_id': 'req-fcde61d4-761a-4011-978f-bef83d6504ad'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.113409 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736d95a987d5459594dd5b1aea58a612', 'request_id': 'req-fcde61d4-761a-4011-978f-bef83d6504ad'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.177748 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4e5a58e1724b21880accc979db66ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.178647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4e5a58e1724b21880accc979db66ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.180999 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] The token cache is being invalidate because project 736d95a987d5459594dd5b1aea58a612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:29.181304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.182066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.201320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1283/2570] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:28 2022] DELETE /identity/v3/projects/736d95a987d5459594dd5b1aea58a612 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:29.201320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:29.201320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:29.201722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4e5a58e1724b21880accc979db66ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.244729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4e5a58e1724b21880accc979db66ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.259878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4e5a58e1724b21880accc979db66ae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.262679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde61d4-761a-4011-978f-bef83d6504ad admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:29.268390 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:29.269801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:29.270329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:29.270808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] PATH_INFO: `/v3/users/bac4a42613ec48dd8ab55bcda46ed1a7` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:29.277341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac4a42613ec48dd8ab55bcda46ed1a7)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:29.278831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1288/2571] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:28 2022] DELETE /identity/v3/users/6c4e5a58e1724b21880accc979db66ae => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:29.279469 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:29.497511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac4a42613ec48dd8ab55bcda46ed1a7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.498191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac4a42613ec48dd8ab55bcda46ed1a7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.587302 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac4a42613ec48dd8ab55bcda46ed1a7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.594897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac4a42613ec48dd8ab55bcda46ed1a7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.606381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac4a42613ec48dd8ab55bcda46ed1a7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:29.612270 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1284/2572] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:29 2022] DELETE /identity/v3/users/bac4a42613ec48dd8ab55bcda46ed1a7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:29.783127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:29.784723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:29.834926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:29.836499 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:29.854860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e073-ac35-4ef6-87b1-8b9b1726faeb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:29.901312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef90ed5-3e57-477e-ac9a-e0d68f9a285d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:29.906142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:29.907086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:29.907297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:29.907580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] PATH_INFO: `/v3/projects/ff695082c1cb48b0b4e58a59f89dd401` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:29.908811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff695082c1cb48b0b4e58a59f89dd401)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:29.910718 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:29.911224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:29.912081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:29.912385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:29.912672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] PATH_INFO: `/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:29.913879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72be2a25eb2f4c41bf5e2d0e9a70cec5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:29.915750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.033065 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff695082c1cb48b0b4e58a59f89dd401', 'request_id': 'req-3bd92ed4-2343-4a80-b461-5b33fdc2a331'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.039522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff695082c1cb48b0b4e58a59f89dd401', 'request_id': 'req-3bd92ed4-2343-4a80-b461-5b33fdc2a331'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.044285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72be2a25eb2f4c41bf5e2d0e9a70cec5', 'request_id': 'req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.045032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff695082c1cb48b0b4e58a59f89dd401', 'request_id': 'req-3bd92ed4-2343-4a80-b461-5b33fdc2a331'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.124651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72be2a25eb2f4c41bf5e2d0e9a70cec5', 'request_id': 'req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.130240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72be2a25eb2f4c41bf5e2d0e9a70cec5', 'request_id': 'req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.141198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] The token cache is being invalidate because project 72be2a25eb2f4c41bf5e2d0e9a70cec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:30.141507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.142126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6c3ea48b-b8b6-499b-bb86-4b35a4a990e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.143644 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1289/2573] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:29 2022] DELETE /identity/v3/projects/72be2a25eb2f4c41bf5e2d0e9a70cec5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:30.149440 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35aca-423c-45b3-b3b8-7fa8e23cfbba None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.149720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35aca-423c-45b3-b3b8-7fa8e23cfbba None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.149992 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35aca-423c-45b3-b3b8-7fa8e23cfbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.167770 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-39c35aca-423c-45b3-b3b8-7fa8e23cfbba None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:30.168996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-39c35aca-423c-45b3-b3b8-7fa8e23cfbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.192609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] The token cache is being invalidate because project ff695082c1cb48b0b4e58a59f89dd401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:30.192892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.193500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.195190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1285/2574] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:29 2022] DELETE /identity/v3/projects/ff695082c1cb48b0b4e58a59f89dd401 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:30.199292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.200705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.227584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1290/2575] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:30.237574 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.237912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.238185 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.255379 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:30.256672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.262154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92ed4-2343-4a80-b461-5b33fdc2a331 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.264442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1291/2576] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:30.266888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.267847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.268127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.268344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.268476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] PATH_INFO: `/v3/users/bfbf51c7b0b84ba0863af6cfcd184b1f` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.269585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbf51c7b0b84ba0863af6cfcd184b1f)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.271516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.277197 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbeb88-5eec-4576-b242-14f9b0b93062 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.282048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.282677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.282954 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.283293 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.283921 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:30.284217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.285813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.297971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1292/2577] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:30.302175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.312147 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ed368-e606-4c74-9e62-08005d704858 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.316314 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.316964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.317221 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.317551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.318260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.320122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.377356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1293/2578] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:30.381417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.406751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbf51c7b0b84ba0863af6cfcd184b1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.407406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbf51c7b0b84ba0863af6cfcd184b1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.440475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e629-c27e-4122-b50e-bc5121768df3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.445153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.445805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.446091 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.446361 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.447030 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.448970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.450402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbf51c7b0b84ba0863af6cfcd184b1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.458124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbf51c7b0b84ba0863af6cfcd184b1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.470121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbf51c7b0b84ba0863af6cfcd184b1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.476025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1286/2579] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:30 2022] DELETE /identity/v3/users/bfbf51c7b0b84ba0863af6cfcd184b1f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:30.517038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1294/2580] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:30.518311 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.519971 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.588289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181339b8-525e-44fc-92e0-9955035caf86 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.592191 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.593437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.593723 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.594034 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.594748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.596320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.606323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1287/2581] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:30.610333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.620004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3297e-7f0b-498e-b53d-a187396b7cdf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.624717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.625377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.625655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.625927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.626752 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.628355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.638344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1295/2582] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:30.643044 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.652706 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81be3-1450-4d0b-9f23-adda0733eba6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.658116 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.663494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.663494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.663494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] PATH_INFO: `/v3/projects/f07e75bb049a410e8de45304eb4bb308/users/3b449cfe924349469402034a885e3017/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.674143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07e75bb049a410e8de45304eb4bb308, user_id=3b449cfe924349469402034a885e3017, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.676803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ee42-a3c4-4f33-92e8-3fa09ba89b42 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.714663 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.716385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.731160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed998cd-f4f4-4005-81b0-91814c017903 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.736790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.737849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.738148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.738452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] PATH_INFO: `/v3/projects/b0851014d2cf41f2ac8d44964d44478d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.739605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0851014d2cf41f2ac8d44964d44478d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:30.741759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:30.780847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1288/2583] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:30 2022] PUT /identity/v3/projects/f07e75bb049a410e8de45304eb4bb308/users/3b449cfe924349469402034a885e3017/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:30.791914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.792201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.792520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.818883 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] MFA Rules not processed for user `3b449cfe924349469402034a885e3017`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:30.820070 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.844647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0851014d2cf41f2ac8d44964d44478d', 'request_id': 'req-635490a8-be93-42c7-89f5-ef3a2122c914'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.881108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1289/2584] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:30.892887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:30.894169 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.901469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0851014d2cf41f2ac8d44964d44478d', 'request_id': 'req-635490a8-be93-42c7-89f5-ef3a2122c914'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.907436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0851014d2cf41f2ac8d44964d44478d', 'request_id': 'req-635490a8-be93-42c7-89f5-ef3a2122c914'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.919105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] The token cache is being invalidate because project b0851014d2cf41f2ac8d44964d44478d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:30.919400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.920050 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-635490a8-be93-42c7-89f5-ef3a2122c914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:30.922011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1296/2585] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:30 2022] DELETE /identity/v3/projects/b0851014d2cf41f2ac8d44964d44478d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:30.926821 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c2cd-835a-4de4-a32b-a42490d7ab70 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.927136 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c2cd-835a-4de4-a32b-a42490d7ab70 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.927417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c2cd-835a-4de4-a32b-a42490d7ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:30.944535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-97d1c2cd-835a-4de4-a32b-a42490d7ab70 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:30.945781 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97d1c2cd-835a-4de4-a32b-a42490d7ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:30.949164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07f19d-a7dc-4137-8c68-432fd892b3f0 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:30.997838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:30.998488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:30.998772 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:30.999554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.001361 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.003000 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1297/2586] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:31.010400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.010688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.010964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.028866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:31.030046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.038546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1298/2587] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:31.042601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.051661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa027fa-4ae2-4eb9-b0e7-fc3ee90e987e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.056710 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.057347 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.057623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.057892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.058628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:31.058927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.060523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.062844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.064292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.075883 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1299/2588] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:31.076061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1290/2589] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:31.076955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.087539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a022e2-ac33-4289-9a5c-63f892450cb7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.093439 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.093627 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.094103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.094378 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.094697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.094823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.095366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.097297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.107737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc4f2-8adc-4256-91cd-a8bf6504491a service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.112350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.113268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.113547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.113817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] PATH_INFO: `/v3/users/3b449cfe924349469402034a885e3017` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.114998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b449cfe924349469402034a885e3017)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.116926 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.178106 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1300/2590] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:31.182340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.240543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07348-badb-4074-92a2-39955b702343 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.245232 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.245886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.246164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.246434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.247175 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.249740 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.286224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b449cfe924349469402034a885e3017'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:31.286892 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b449cfe924349469402034a885e3017'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:31.355345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1301/2591] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:31.359167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b449cfe924349469402034a885e3017'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:31.366512 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b449cfe924349469402034a885e3017'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:31.368568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.370506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.379121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-82deddb4-5b55-48ce-8521-2f5dd45a57fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b449cfe924349469402034a885e3017'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:31.383271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592f99-bf7e-40b2-bd26-91f89f857a6e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.385155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1291/2592] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:31 2022] DELETE /identity/v3/users/3b449cfe924349469402034a885e3017 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:31.387850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.388787 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.389129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.389398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.389624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.390092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.390204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.390491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.391672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.405021 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1302/2593] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:31.406474 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.407235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:31.408556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.416648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ec3fe-b65b-4e08-a8da-f4c1e0d8da59 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.465824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1292/2594] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:31.471159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.471823 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.472097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.472377 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.473098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.474680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.475680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.477020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.485111 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1303/2595] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:31.489012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.498165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118cac-ce74-4328-86a3-38897a3d38ab admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.503342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.504244 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.504553 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.504825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] PATH_INFO: `/v3/projects/fe5c1c0c2dfb4a5d8443e71541eaa9ef/users/d5682e2aa81e418e93c5356c71211b5a/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.519099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5c1c0c2dfb4a5d8443e71541eaa9ef, user_id=d5682e2aa81e418e93c5356c71211b5a, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.521747 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.534979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34074-073b-41a3-9d51-ec949bfaa473 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.538654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.539294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.539573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.539850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.549586 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.551012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd50eb-afdc-41c6-9017-bff186715993 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.560459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1293/2596] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:31.582040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1304/2597] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:31 2022] PUT /identity/v3/projects/fe5c1c0c2dfb4a5d8443e71541eaa9ef/users/d5682e2aa81e418e93c5356c71211b5a/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:31.598897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.599114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.599391 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.625996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] MFA Rules not processed for user `d5682e2aa81e418e93c5356c71211b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:31.627138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.690744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1294/2598] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:31.695236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.755508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d7bb-888c-4a56-bc84-579fa0fcbf04 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.760569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.761264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.761548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.761849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.762544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.764466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.831918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1305/2599] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:31.833084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.844548 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cfe2-7e21-4070-83f4-6a6058421160 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.900301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.900938 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.901217 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.901489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.902168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.904241 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.943702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.945450 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:31.958514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6335e9-8dfc-455a-be7c-beac2ee1ee31 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:31.963190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:31.964051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:31.964338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:31.964653 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] PATH_INFO: `/v3/projects/f07e75bb049a410e8de45304eb4bb308` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:31.965834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07e75bb049a410e8de45304eb4bb308)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:31.967734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:31.981930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1295/2600] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:31 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:31.985780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:31.995247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67f97-b7a7-452d-ab8f-05fba1c4fc72 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.000025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.000702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.000985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.001260 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.002006 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.003593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.013235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1296/2601] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:32.017822 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.026944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173310-3aa5-4473-8b5f-d836c7aaf64e admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.032219 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.033124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.033411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.033680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] PATH_INFO: `/v3/projects/6788a696135b4c8f8cc6c1a6b437045e/users/1f4bb596b94b4da09f0d4387ea152d1f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.048357 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6788a696135b4c8f8cc6c1a6b437045e, user_id=1f4bb596b94b4da09f0d4387ea152d1f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.051082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.118980 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1297/2602] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:32 2022] PUT /identity/v3/projects/6788a696135b4c8f8cc6c1a6b437045e/users/1f4bb596b94b4da09f0d4387ea152d1f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:32.122879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.129421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07e75bb049a410e8de45304eb4bb308', 'request_id': 'req-9647b87c-f732-43f9-9180-a5d128d3d4dc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:32.182023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718db56-a0b9-4647-9b6a-7a929f7fcbbd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.198223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07e75bb049a410e8de45304eb4bb308', 'request_id': 'req-9647b87c-f732-43f9-9180-a5d128d3d4dc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:32.204596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07e75bb049a410e8de45304eb4bb308', 'request_id': 'req-9647b87c-f732-43f9-9180-a5d128d3d4dc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:32.216149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] The token cache is being invalidate because project f07e75bb049a410e8de45304eb4bb308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:32.216491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:32.217192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9647b87c-f732-43f9-9180-a5d128d3d4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:32.219432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1306/2603] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:31 2022] DELETE /identity/v3/projects/f07e75bb049a410e8de45304eb4bb308 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:32.224107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.224490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.224763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.239025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.239702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.239982 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.240258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.241025 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.242436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:32.242644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1905ba-3a35-40ac-ab1f-15a91804f462 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.243642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.252103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1307/2604] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:32.253077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1298/2605] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:32.257099 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.258418 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.260033 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.260429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.260714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.270630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ec6b-b36e-4f53-bfa4-916f6afab2ae None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.275449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.276324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.276634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.276908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] PATH_INFO: `/v3/projects/6788a696135b4c8f8cc6c1a6b437045e/users/1f4bb596b94b4da09f0d4387ea152d1f/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.278589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:32.279617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6788a696135b4c8f8cc6c1a6b437045e, user_id=1f4bb596b94b4da09f0d4387ea152d1f, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.279946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.282308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b1bf-bbb7-41ec-8c21-8e55df9ef23d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.288112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1299/2606] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:32.291920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.292526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1308/2607] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:32 2022] PUT /identity/v3/projects/6788a696135b4c8f8cc6c1a6b437045e/users/1f4bb596b94b4da09f0d4387ea152d1f/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:32.300873 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2adb-20bd-47ab-ac47-bfdc905d526d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.304001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.304422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.304703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.331808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] MFA Rules not processed for user `1f4bb596b94b4da09f0d4387ea152d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:32.333043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.357081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.357816 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.358164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.358538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.359285 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:32.359581 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.361197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.372683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1300/2608] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:32.377248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.386631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c241-7e7b-4a23-a040-a3ba16ca99f4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.391986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.392515 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.392854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.393060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.393891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.395765 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.403190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1309/2609] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:32.414481 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.415813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.470730 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3434ea-6a18-4b3f-bbf5-db52dcd2f0cc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.474357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.474999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.475279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.475552 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.480511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1301/2610] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:32.488572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.488691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.488691 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.495681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1310/2611] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:32.543813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106e428-4435-4a70-88c4-d86ca1a0e67b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.548714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.549368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.549643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.549920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.550591 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.552609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.639284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1302/2612] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:32.646134 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.656438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e436b1-7f84-4150-9c02-354bebfef8ab service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.661438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.662082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.662366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.662643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.663350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.665071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.675981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1311/2613] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:32:32.679460 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.689800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e0c1-e7c5-4782-899d-2810d16456d6 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.694416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.695079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.695348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.695606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.699599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.702821 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.707902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.714937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1303/2614] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:32.715908 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.725755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f74b4-fe40-4b32-97eb-d8abb6e8c9d2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.730497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.731615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.731739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.731931 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] PATH_INFO: `/v3/projects/4874d160b6194ad9bdcfcb8d4d251c28/users/42f3e624524c497a964ad1f8a39d43c6/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.746743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4874d160b6194ad9bdcfcb8d4d251c28, user_id=42f3e624524c497a964ad1f8a39d43c6, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.750150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a1bf-b5d2-4567-88b3-361fe4cd9eb4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.764310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ef46b-de65-4640-b23a-3add8c82ab97 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.767970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.768646 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.768927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.769201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.770980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.810192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1304/2615] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:32 2022] PUT /identity/v3/projects/4874d160b6194ad9bdcfcb8d4d251c28/users/42f3e624524c497a964ad1f8a39d43c6/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:32.826775 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.827060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.827835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:32.829656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:32.831094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:32.840132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1312/2616] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:32.854332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] MFA Rules not processed for user `42f3e624524c497a964ad1f8a39d43c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:32.855538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.917282 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1305/2617] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:32.928545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:32.929955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:32.941087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312896-da17-4b5e-b332-bbd88a21569b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:32.990169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:32.990808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:32.991036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:32.991309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:33.000343 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:33.001892 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:33.010641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1313/2618] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:36.873216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:36.933575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa6b73-99d7-46f0-891b-d99f38ca8e6c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:36.938574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:36.939435 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:36.939715 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:36.939989 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] PATH_INFO: `/v3/users/42f3e624524c497a964ad1f8a39d43c6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:36.941190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f3e624524c497a964ad1f8a39d43c6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:36.943084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:36.956594 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:36.957999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:36.971161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18e1af-dbc9-4e7e-803f-e98d4679b8fe service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:36.975919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:36.976810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:36.977090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:36.977359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] PATH_INFO: `/v3/users/bbd8db1b47fb4a88b9f45cf1a3d370b2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:36.978515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd8db1b47fb4a88b9f45cf1a3d370b2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:36.980462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:37.126468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f3e624524c497a964ad1f8a39d43c6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.127032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f3e624524c497a964ad1f8a39d43c6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.153986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd8db1b47fb4a88b9f45cf1a3d370b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.154608 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd8db1b47fb4a88b9f45cf1a3d370b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.161154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd8db1b47fb4a88b9f45cf1a3d370b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.193045 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f3e624524c497a964ad1f8a39d43c6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.199893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f3e624524c497a964ad1f8a39d43c6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.211199 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-25abd930-d25d-4394-93d6-e1065c35cf11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f3e624524c497a964ad1f8a39d43c6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.217092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1306/2619] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:36 2022] DELETE /identity/v3/users/42f3e624524c497a964ad1f8a39d43c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:37.221458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:37.221749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:37.222024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:37.238362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:37.243506 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:37.261758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd8db1b47fb4a88b9f45cf1a3d370b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.273927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a7f8efe-a053-41a5-8316-82783ebfd26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd8db1b47fb4a88b9f45cf1a3d370b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:37.279845 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1314/2620] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:36 2022] DELETE /identity/v3/users/bbd8db1b47fb4a88b9f45cf1a3d370b2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:37.284756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:37.285043 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:37.285323 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:37.296673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1307/2621] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:37.302469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:37.303688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:37.306690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:37.307978 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:37.363229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1315/2622] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:37.364545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ae2a-af03-4f38-ad9c-17a6af1bce90 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:37.373350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:37.410542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c09d-620a-4909-a570-b457792375de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:37.411102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c09d-620a-4909-a570-b457792375de service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:37.411380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c09d-620a-4909-a570-b457792375de service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:37.411654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c09d-620a-4909-a570-b457792375de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:37.420504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c09d-620a-4909-a570-b457792375de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:37.422846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c09d-620a-4909-a570-b457792375de service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:37.425680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35a29-3c69-4db6-821d-77f91413c0dc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:37.429311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:37.429938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:37.430214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:37.430483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:37.432513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1308/2623] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:37.440755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:37.442179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:37.453799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1316/2624] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:37.954965 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c09d-620a-4909-a570-b457792375de service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:37.956386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-da70c09d-620a-4909-a570-b457792375de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:37.971347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c09d-620a-4909-a570-b457792375de service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:37.977068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:37.977929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:37.978203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:37.978487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] PATH_INFO: `/v3/projects/4874d160b6194ad9bdcfcb8d4d251c28` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:37.979635 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4874d160b6194ad9bdcfcb8d4d251c28)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:37.981545 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.000572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.002109 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.016011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef4f-43d6-4596-b854-6e32bc78042b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.021572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.022417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.022695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.022960 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] PATH_INFO: `/v3/projects/011a84a950e44622885840639b673047` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.024129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011a84a950e44622885840639b673047)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.026176 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.090585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4874d160b6194ad9bdcfcb8d4d251c28', 'request_id': 'req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.097350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4874d160b6194ad9bdcfcb8d4d251c28', 'request_id': 'req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.102588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4874d160b6194ad9bdcfcb8d4d251c28', 'request_id': 'req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.142025 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011a84a950e44622885840639b673047', 'request_id': 'req-75312db7-8bff-4b7c-8683-35eea7b93607'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.221594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] The token cache is being invalidate because project 4874d160b6194ad9bdcfcb8d4d251c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:38.221808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.222441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b447fb47-6f1d-42c1-99c5-c7db3ed682ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.224022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1309/2625] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:37 2022] DELETE /identity/v3/projects/4874d160b6194ad9bdcfcb8d4d251c28 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:38.228953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff588bb-8184-4c1a-9dfa-712166951004 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.229235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff588bb-8184-4c1a-9dfa-712166951004 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.229508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff588bb-8184-4c1a-9dfa-712166951004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.246774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4ff588bb-8184-4c1a-9dfa-712166951004 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:38.247933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4ff588bb-8184-4c1a-9dfa-712166951004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.284575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011a84a950e44622885840639b673047', 'request_id': 'req-75312db7-8bff-4b7c-8683-35eea7b93607'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.290356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011a84a950e44622885840639b673047', 'request_id': 'req-75312db7-8bff-4b7c-8683-35eea7b93607'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.301345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] The token cache is being invalidate because project 011a84a950e44622885840639b673047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:38.301634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.302284 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.303843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1317/2626] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:37 2022] DELETE /identity/v3/projects/011a84a950e44622885840639b673047 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:38.307660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.308854 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1310/2627] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:38.309303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.316716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.317050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.317333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.322773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312db7-8bff-4b7c-8683-35eea7b93607 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.328122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.329028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.329305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.329569 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] PATH_INFO: `/v3/users/0b397621e94140ef96bff9a88aeb3a8d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.335118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b397621e94140ef96bff9a88aeb3a8d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.335118 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.337328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:38.337671 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.350425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1311/2628] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:38.354776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.363501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf200c6-03d6-4166-8c8f-42fae6f4dcdd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.367984 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.369095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.369095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.369273 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.369909 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:38.370209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.371767 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.383572 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1312/2629] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:32:38.387746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.397373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdc6a-ec14-488d-b8ee-85e54e14facd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.401889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.402481 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.402758 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.403031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.403709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.405598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.486200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b397621e94140ef96bff9a88aeb3a8d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.486881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b397621e94140ef96bff9a88aeb3a8d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.491445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1313/2630] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:38 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:38.493802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b397621e94140ef96bff9a88aeb3a8d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.495329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.496918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.535670 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b397621e94140ef96bff9a88aeb3a8d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.548149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b397621e94140ef96bff9a88aeb3a8d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:38.554283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1318/2631] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:38 2022] DELETE /identity/v3/users/0b397621e94140ef96bff9a88aeb3a8d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:38.558501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846b2ff-12b7-4558-8ea2-3b52bd026588 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.615176 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.615860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.616126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.616423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.617115 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.619088 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.764814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1314/2632] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:38 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:32:38.769048 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.778760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f68fd-18e9-4d5d-aae3-173b2dda3d54 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.783398 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.784059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.784342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.784647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.785394 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.787023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.797761 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1319/2633] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:38.801680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.812218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be825-339c-4132-82b8-d9d57d859d18 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.816920 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.817668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.818012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.818351 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.819137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.820831 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.833979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1315/2634] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:38.835207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.844922 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1118-8289-4331-ba50-81293d159934 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.849437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.850410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.850753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.851094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] PATH_INFO: `/v3/projects/352c16e51c3e44d9b54a0c94d6f74d13/users/0dc9206365dc4e0b990e65fe795290e5/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.866066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352c16e51c3e44d9b54a0c94d6f74d13, user_id=0dc9206365dc4e0b990e65fe795290e5, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:38.868699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982e54-90ea-4317-971f-664f6ec402e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:38.926610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:38.928484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.942239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43003-a48a-41fc-8f74-59cfad8056dd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:38.952127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1320/2635] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:38 2022] PUT /identity/v3/projects/352c16e51c3e44d9b54a0c94d6f74d13/users/0dc9206365dc4e0b990e65fe795290e5/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:38.957149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.957471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:38.957768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:38.974464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:38.975742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:38.998274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:38.999685 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:38.999961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.000231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] PATH_INFO: `/v3/projects/a33fb97953a34430ab19c2884431bc67` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.001484 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33fb97953a34430ab19c2884431bc67)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.003444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.033408 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1321/2636] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:39.044267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.045617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.100158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63799c-e656-44dd-8d8c-df2406d3ca0d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.112863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33fb97953a34430ab19c2884431bc67', 'request_id': 'req-1bce461d-d526-4185-b566-b1a0507b9b74'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:39.119789 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33fb97953a34430ab19c2884431bc67', 'request_id': 'req-1bce461d-d526-4185-b566-b1a0507b9b74'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:39.125315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33fb97953a34430ab19c2884431bc67', 'request_id': 'req-1bce461d-d526-4185-b566-b1a0507b9b74'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:39.147447 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.148097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.148403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.148682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.192167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] The token cache is being invalidate because project a33fb97953a34430ab19c2884431bc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:39.192511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:39.193151 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-1bce461d-d526-4185-b566-b1a0507b9b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:39.194753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1316/2637] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:38 2022] DELETE /identity/v3/projects/a33fb97953a34430ab19c2884431bc67 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:32:39.199580 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.199869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.200173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.207658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.209344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270903c-ee1c-4f67-9b7d-a9abe795d307 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.216855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:39.218554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.219518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1322/2638] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:39.227275 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1317/2639] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:39.235411 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.235702 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.235981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.253276 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:39.254423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.262384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1323/2640] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:39.266602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.276126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb656d8-2816-42fe-9e35-60c56981c721 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.281326 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.281963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.282236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.282502 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.283226 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:39.283531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.285192 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.300957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1318/2641] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:32:39.302158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.311369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33db32-b269-4e31-8fb4-356a105db8e7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.316336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.317145 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.317332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.317682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.318295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.320191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.346521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.346521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.415283 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c2e4-aa14-499b-889d-6a097cfa3c2a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.420258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.420953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.421235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.421492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.423569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.434433 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.436020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.443689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1324/2642] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:39.444755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.445866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1319/2643] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:39.512478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b91f-0fb5-4331-b970-9ac6e204d2bb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.518193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.518901 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.519238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.519634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.520652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.522583 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.625166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1325/2644] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:39.626353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.636870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e7fd9-e5c0-4e09-b9d8-7d0beff88f5c service placement] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.642117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.643429 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.643791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.644050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.644796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.646362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.660144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1320/2645] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:39.661792 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.672471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7a98c-7087-45d3-8b7a-9271b7ffaa4c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.678077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.679096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.679096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.679283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.680059 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.681692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398807ec-8947-4332-b08d-9f11bec2341e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.692857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1326/2646] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:39.697342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.708644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3499a-9e5b-4d2b-a867-2b2b0c9c5428 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.713540 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.714621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.714914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.715186 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] PATH_INFO: `/v3/projects/a03a3cfa1d4049489cf0d5483e928a5c/users/b66412704873488e81815d51726c3747/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.732139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a3cfa1d4049489cf0d5483e928a5c, user_id=b66412704873488e81815d51726c3747, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.735127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:39.796450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1321/2647] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:39 2022] PUT /identity/v3/projects/a03a3cfa1d4049489cf0d5483e928a5c/users/b66412704873488e81815d51726c3747/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:39.808191 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.808559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.808873 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.837267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] MFA Rules not processed for user `b66412704873488e81815d51726c3747`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:39.839689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:39.905962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1327/2648] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:39.910621 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:39.979811 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d36e05-72eb-424a-9bab-0d721f137cdb admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:39.984743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:39.985511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:39.985893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:39.986266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:39.987486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:39.989430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.060564 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1322/2649] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:39 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:40.062077 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.072755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ba966-feba-4a39-b491-e39bc6ab3957 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.131054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.131755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.132036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.132310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.133033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.134959 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.223509 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1328/2650] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:40 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:40.226336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.237230 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aada2-8d9b-4612-8e9a-8a1d76be0172 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.242023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.242720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.243050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.243325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.244050 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.245680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.257472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1323/2651] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:40.262224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.271674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3975282-3454-4a1f-b606-08cb5870e1af admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.276989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.277955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.278207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.278477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] PATH_INFO: `/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938/users/23a8e7e716ca4c97b5313ecd596e6030/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.293799 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e0a86bd9354cc0a8bd1077a95e9938, user_id=23a8e7e716ca4c97b5313ecd596e6030, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.297432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7ec33-43f3-4464-9ea6-d0b240249870 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.406066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1329/2652] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:40 2022] PUT /identity/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938/users/23a8e7e716ca4c97b5313ecd596e6030/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:40.410640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.422777 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5c68-82c8-44eb-bd8e-517750012e82 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.496657 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.496945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.497228 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.505861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.506551 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.506832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.507105 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.507846 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.509518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.521946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1324/2653] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:40.527802 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.531500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] MFA Rules not processed for user `0dc9206365dc4e0b990e65fe795290e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:40.532896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:40.539362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934ac6b-2f62-49be-b78f-ecc17a928f62 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.544678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.545547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.546402 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.546682 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] PATH_INFO: `/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938/users/23a8e7e716ca4c97b5313ecd596e6030/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.550536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e0a86bd9354cc0a8bd1077a95e9938, user_id=23a8e7e716ca4c97b5313ecd596e6030, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.556687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f23bf-5154-46ff-86b3-c07b293be381 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.578628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1325/2654] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:40 2022] PUT /identity/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938/users/23a8e7e716ca4c97b5313ecd596e6030/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:40.580531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.580827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.587313 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.618201 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] MFA Rules not processed for user `23a8e7e716ca4c97b5313ecd596e6030`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:40.619480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:40.624514 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1330/2655] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:40.634054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.636261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:40.707304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde140ca-25f1-44b9-9966-0be2c153dd28 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.712403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1326/2656] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:40.749711 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:40.752861 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:40.779122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.779796 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.781178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.781178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.818156 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bcef-109a-4f66-8b1f-699efa4ad0ef None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:40.822047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:40.822697 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:40.823514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:40.823798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:40.838863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.840310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2948-198b-4743-b80f-fbd19f55260a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.850068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1331/2657] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:40.886117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:40.887648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:40.897827 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1327/2658] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:32:42.489518 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07105-594e-40e6-a4e4-391b80a93735 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:42.490032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07105-594e-40e6-a4e4-391b80a93735 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:42.490127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07105-594e-40e6-a4e4-391b80a93735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:42.507453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-10e07105-594e-40e6-a4e4-391b80a93735 None None] MFA Rules not processed for user `0dc9206365dc4e0b990e65fe795290e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:42.508685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-10e07105-594e-40e6-a4e4-391b80a93735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:42.515934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1332/2659] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:43.893801 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:43.955720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef1971-4a45-4788-bd7d-63256e38820f service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:43.960274 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:43.961181 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:43.961488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:43.961755 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] PATH_INFO: `/v3/users/b66412704873488e81815d51726c3747` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:43.962953 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66412704873488e81815d51726c3747)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:43.964887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:44.137126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66412704873488e81815d51726c3747'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.137773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66412704873488e81815d51726c3747'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.204598 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66412704873488e81815d51726c3747'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.212518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66412704873488e81815d51726c3747'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.225254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66412704873488e81815d51726c3747'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.231489 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1328/2660] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:43 2022] DELETE /identity/v3/users/b66412704873488e81815d51726c3747 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:44.235948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:44.236457 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:44.236556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:44.255082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:44.256401 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:44.323468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1333/2661] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:32:44.335406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:44.337362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:44.407272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c366-a4f2-4d08-990b-62eeb261be7b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:44.411031 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:44.411686 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:44.411947 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:44.412214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:44.422449 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:44.424343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:44.435877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1329/2662] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:32:44.794372 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:44.796346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:44.808982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb568e-c126-485c-9e7b-076f7a82cd8e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:44.814306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:44.815159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:44.815433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:44.815699 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] PATH_INFO: `/v3/projects/a03a3cfa1d4049489cf0d5483e928a5c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:44.816902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03a3cfa1d4049489cf0d5483e928a5c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:44.818773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:44.918254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03a3cfa1d4049489cf0d5483e928a5c', 'request_id': 'req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.952788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03a3cfa1d4049489cf0d5483e928a5c', 'request_id': 'req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.958656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03a3cfa1d4049489cf0d5483e928a5c', 'request_id': 'req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.969980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] The token cache is being invalidate because project a03a3cfa1d4049489cf0d5483e928a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:44.970267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.970899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:44.972458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1334/2663] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:44 2022] DELETE /identity/v3/projects/a03a3cfa1d4049489cf0d5483e928a5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:44.976556 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:44.986850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be2425-0e2e-42ef-93e4-542c5e9f5e62 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:45.042317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:45.043235 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:45.043523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:45.043792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] PATH_INFO: `/v3/users/23a8e7e716ca4c97b5313ecd596e6030` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:45.045039 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a8e7e716ca4c97b5313ecd596e6030)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:45.047862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:45.220123 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a8e7e716ca4c97b5313ecd596e6030'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:45.220940 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a8e7e716ca4c97b5313ecd596e6030'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:45.319750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a8e7e716ca4c97b5313ecd596e6030'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:45.328895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a8e7e716ca4c97b5313ecd596e6030'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:45.353337 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-81b3598d-a72a-488b-8e57-4cb9c7c10850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a8e7e716ca4c97b5313ecd596e6030'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:45.356944 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1330/2664] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:32:44 2022] DELETE /identity/v3/users/23a8e7e716ca4c97b5313ecd596e6030 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:45.904396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:45.906344 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:45.929591 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6d00-ac7e-4ac7-aa88-4c9ff81225bb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.000271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.004305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.004305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.004305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] PATH_INFO: `/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.004305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e0a86bd9354cc0a8bd1077a95e9938)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.004766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.113928 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e0a86bd9354cc0a8bd1077a95e9938', 'request_id': 'req-be6f52f0-5398-43e7-a456-a4475e18f81e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:46.176055 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e0a86bd9354cc0a8bd1077a95e9938', 'request_id': 'req-be6f52f0-5398-43e7-a456-a4475e18f81e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:46.182006 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e0a86bd9354cc0a8bd1077a95e9938', 'request_id': 'req-be6f52f0-5398-43e7-a456-a4475e18f81e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:46.193897 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] The token cache is being invalidate because project a5e0a86bd9354cc0a8bd1077a95e9938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:32:46.194178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:46.194819 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-be6f52f0-5398-43e7-a456-a4475e18f81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:32:46.196571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1335/2665] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:32:45 2022] DELETE /identity/v3/projects/a5e0a86bd9354cc0a8bd1077a95e9938 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:46.201340 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.201824 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.201922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.219423 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:46.221511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:46.280327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1331/2666] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:46.287940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.288227 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.288628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.309296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:46.311800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:46.330435 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1336/2667] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:46.337705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.350384 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35952-2c75-4e7c-869c-045b9df6fc50 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.355158 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.355814 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.356395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.356395 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.357092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:32:46.357434 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.359559 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.374954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1332/2668] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:32:46.376242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.385341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6457e6-d815-470c-8a5a-62e51f1b907d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.392794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.392794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.392794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.392794 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.393480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.395341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.480647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1337/2669] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:32:46 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:46.485027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.494844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc266c-ee41-483b-b447-86f18ae843fa admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.560517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.561307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.561652 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.562018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.562778 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.564818 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.660807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1333/2670] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:32:46 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:32:46.661808 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.673271 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b2d4-b1ee-405b-b671-537109449dc2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.678165 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.678905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.679194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.683315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.683315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.683315 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.693483 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1338/2671] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:46.697574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.707866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de872-59e7-4fce-9ae9-899ea7269103 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.712730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.713418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.713727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.714002 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.714733 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.716442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ffc43-53ca-445a-aca1-c85b1cc0b5dd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.730661 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1334/2672] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:32:46.732090 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.743723 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a23ae-991e-469d-bc20-a70cd3bb0650 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:46.749166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:46.750093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.750370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.750642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] PATH_INFO: `/v3/projects/020543613d394717af14c5143698fa5f/users/9dca2d1b938e4327a3f98850773accd8/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.766617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020543613d394717af14c5143698fa5f, user_id=9dca2d1b938e4327a3f98850773accd8, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:46.769545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:46.828011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1339/2673] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:32:46 2022] PUT /identity/v3/projects/020543613d394717af14c5143698fa5f/users/9dca2d1b938e4327a3f98850773accd8/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:32:46.838709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:46.838995 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:46.839266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:46.874439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] MFA Rules not processed for user `9dca2d1b938e4327a3f98850773accd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:32:46.875646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:46.940255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1335/2674] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:32:46.951656 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:32:46.953904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:32:47.007472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392547a9-e970-4e56-80a7-afb8f5a43cc7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:32:47.011181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e3a64bbcfa4449b4aba61a201c1c3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:32:47.011822 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:32:47.012098 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:32:47.012382 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:32:47.020872 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:32:47.022286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d27bd-3b6c-4441-90e2-dda9d5e54c7a service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:32:47.031601 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1340/2675] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:02.400513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:02.401902 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:02.456154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32db81-dccf-4c9c-94b4-0ede08cd5bc2 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:02.459643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:02.460269 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:02.460574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:02.460847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:02.462535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:02.516928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:02.518328 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:02.527380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1336/2676] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:08.874904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:08.875432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:08.875432 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:08.892522 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] MFA Rules not processed for user `0dc9206365dc4e0b990e65fe795290e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:08.895038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:08.947866 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1341/2677] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:10.048889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:10.059278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d67e6a-d358-4333-866a-64875a1b0aef service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:10.063066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:10.063884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:10.064240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:10.064461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:10.068293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:10.135813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:10.137452 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:10.147347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1337/2678] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:18.471421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:18.476618 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:18.491841 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf227f-70c7-4b42-8d2f-292657728bc0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:18.498051 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:18.499248 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:18.499568 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:18.499916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] PATH_INFO: `/v3/users/e5b37675409042d8bbf38439c3549bd7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:18.501425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b37675409042d8bbf38439c3549bd7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:18.503711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:18.710286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b37675409042d8bbf38439c3549bd7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:18.710941 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b37675409042d8bbf38439c3549bd7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:18.717912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b37675409042d8bbf38439c3549bd7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:18.786715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b37675409042d8bbf38439c3549bd7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:18.799135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b37675409042d8bbf38439c3549bd7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:18.804990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1342/2679] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:18 2022] DELETE /identity/v3/users/e5b37675409042d8bbf38439c3549bd7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:19.114128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:19.127224 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed769-6e0f-46c7-aa86-a3ef0eff04cf service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:19.183807 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:19.184691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:19.184969 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:19.185262 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] PATH_INFO: `/v3/projects/cfe9e07f034941009488167dde06eac4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:19.186411 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe9e07f034941009488167dde06eac4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:19.188281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:19.282670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe9e07f034941009488167dde06eac4', 'request_id': 'req-e313b215-d7b8-43a4-be77-c37e26c784af'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.288525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe9e07f034941009488167dde06eac4', 'request_id': 'req-e313b215-d7b8-43a4-be77-c37e26c784af'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.293894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe9e07f034941009488167dde06eac4', 'request_id': 'req-e313b215-d7b8-43a4-be77-c37e26c784af'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.348881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] The token cache is being invalidate because project cfe9e07f034941009488167dde06eac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:19.348881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.349526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.351097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1338/2680] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:19 2022] DELETE /identity/v3/projects/cfe9e07f034941009488167dde06eac4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:19.355114 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:19.356521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:19.370096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c7f8-f773-4877-b326-89bc886da0a0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:19.424523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:19.425477 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:19.425840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:19.426727 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] PATH_INFO: `/v3/users/9b8e5754acea4b6abe39c5c66b1b21a5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:19.427896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8e5754acea4b6abe39c5c66b1b21a5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:19.429824 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:19.595179 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8e5754acea4b6abe39c5c66b1b21a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.596181 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8e5754acea4b6abe39c5c66b1b21a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.603706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8e5754acea4b6abe39c5c66b1b21a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.701388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8e5754acea4b6abe39c5c66b1b21a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.713865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-704d1411-1fbf-4207-b66b-2f21382c9c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8e5754acea4b6abe39c5c66b1b21a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:19.719902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1343/2681] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:19 2022] DELETE /identity/v3/users/9b8e5754acea4b6abe39c5c66b1b21a5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:19.942576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:19.944168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:19.957577 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b215-d7b8-43a4-be77-c37e26c784af admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.017746 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.018630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.018912 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.019189 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] PATH_INFO: `/v3/projects/4a8686850db14857b14e7034ef2c462a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.020921 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8686850db14857b14e7034ef2c462a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.022851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.149051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8686850db14857b14e7034ef2c462a', 'request_id': 'req-a3bc9533-5030-4f57-a976-04a0864dad63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:20.155516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8686850db14857b14e7034ef2c462a', 'request_id': 'req-a3bc9533-5030-4f57-a976-04a0864dad63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:20.161266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8686850db14857b14e7034ef2c462a', 'request_id': 'req-a3bc9533-5030-4f57-a976-04a0864dad63'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:20.249693 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] The token cache is being invalidate because project 4a8686850db14857b14e7034ef2c462a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:20.249996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:20.250607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-a3bc9533-5030-4f57-a976-04a0864dad63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:20.252127 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1339/2682] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:19 2022] DELETE /identity/v3/projects/4a8686850db14857b14e7034ef2c462a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:20.257541 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.257831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.258103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.275535 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:20.276732 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:20.335123 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1344/2683] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:20.342830 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.343117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.343388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.361649 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:20.362829 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:20.370647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1340/2684] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:20.374869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.384809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8989-982c-47df-a95a-2ff5b0b69460 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.389964 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.390605 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.390886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.391153 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.391855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:33:20.392156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.393804 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.405478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1345/2685] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:33:20.409803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.418732 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b3e3-0ce5-4fe3-a6d8-a218bcd6dd61 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.423676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.424439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.424704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.425004 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.425679 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.427589 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.524889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1341/2686] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:20 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:20.529096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.539198 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad6d4-de49-495d-b04d-865baa08944a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.599011 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.599706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.599961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.600230 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.600990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.602952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.735434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1346/2687] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:20 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:20.740193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.749967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f2a0-2a47-4a05-856d-783085670125 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.754963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.755610 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.755887 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.756173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.756935 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.758497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.768538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1342/2688] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:20.772212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.782108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358342c-27fd-478f-85db-9ad9cc9225a2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.786648 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.787291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.787573 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.787849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.788682 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.790272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc983368-259d-43b1-8544-df18b53d4bd5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.800174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1347/2689] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:20.804651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:20.814173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70131cae-0add-499c-86f7-ec78db45acc1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:20.819248 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:20.820095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.820396 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.820672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] PATH_INFO: `/v3/projects/63e643aec806497bb42c62ea76c402f4/users/dff60ffc00c94bacb6218cfd4ea56978/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.835445 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e643aec806497bb42c62ea76c402f4, user_id=dff60ffc00c94bacb6218cfd4ea56978, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:20.838386 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:20.913602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1343/2690] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:20 2022] PUT /identity/v3/projects/63e643aec806497bb42c62ea76c402f4/users/dff60ffc00c94bacb6218cfd4ea56978/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:20.919327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:20.919617 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:20.919923 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:20.938203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:20.941278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:21.004949 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1348/2691] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:21.014857 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:21.026985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:21.079437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c817-41d3-42ba-8119-44da34a7f4b7 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:21.083958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:21.084594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:21.084874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:21.085182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:21.095547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:21.096872 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:21.107448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1344/2692] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:21.652204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:21.653760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:21.667495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0a33-50fa-4317-910b-28218faf81da None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:21.673212 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:21.678104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:21.678104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:21.678104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] PATH_INFO: `/v3/users/d5682e2aa81e418e93c5356c71211b5a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:21.678104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5682e2aa81e418e93c5356c71211b5a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:21.679504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:21.865203 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5682e2aa81e418e93c5356c71211b5a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:21.866470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5682e2aa81e418e93c5356c71211b5a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:21.874208 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5682e2aa81e418e93c5356c71211b5a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:21.909060 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:21.912071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:21.924272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5682e2aa81e418e93c5356c71211b5a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:21.926745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d07d-b371-4e02-a9c5-a168cb1e4ebc service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:21.932602 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:21.933823 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:21.934361 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:21.934812 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] PATH_INFO: `/v3/users/9dca2d1b938e4327a3f98850773accd8` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:21.936206 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dca2d1b938e4327a3f98850773accd8)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:21.938604 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:21.943367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1c99999-b83e-48cc-8cfc-85f2d0d476aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5682e2aa81e418e93c5356c71211b5a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:21.953931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1349/2693] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:21 2022] DELETE /identity/v3/users/d5682e2aa81e418e93c5356c71211b5a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:21.955639 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:21.956685 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:21.957362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:21.977937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:21.979426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:22.036956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1350/2694] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:22.046365 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:22.047957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:22.103027 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ee7a-dc02-4035-b9e1-e53262e09336 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:22.107122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:22.107766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:22.108049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:22.108759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:22.117769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:22.119139 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bafd1-9dcb-4e38-aee6-dee68887a3f0 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:22.129257 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1351/2695] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:33:22.162103 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dca2d1b938e4327a3f98850773accd8'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.162862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dca2d1b938e4327a3f98850773accd8'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.238368 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dca2d1b938e4327a3f98850773accd8'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.245774 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dca2d1b938e4327a3f98850773accd8'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.257277 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dca2d1b938e4327a3f98850773accd8'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.263237 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1345/2696] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:21 2022] DELETE /identity/v3/users/9dca2d1b938e4327a3f98850773accd8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:22.267717 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:22.268863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:22.268863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:22.287589 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:22.288830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:22.351705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1352/2697] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:33:22.361140 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:22.362985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:22.436664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0cafe-d283-400f-a791-4ada12c77a46 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:22.442130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:22.443497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:22.443948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:22.445487 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:22.458240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:22.462049 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:22.473600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1346/2698] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:22.601907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:22.611571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:22.635630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60626a83-dd3b-4d6e-bcb5-e68c6c14a87d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:22.641873 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:22.643713 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:22.644164 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:22.645275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] PATH_INFO: `/v3/projects/fe5c1c0c2dfb4a5d8443e71541eaa9ef` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:22.646846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5c1c0c2dfb4a5d8443e71541eaa9ef)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:22.649250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:22.795278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5c1c0c2dfb4a5d8443e71541eaa9ef', 'request_id': 'req-666e3f19-147e-4cbd-ad46-9cb4def3ca30'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.856262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5c1c0c2dfb4a5d8443e71541eaa9ef', 'request_id': 'req-666e3f19-147e-4cbd-ad46-9cb4def3ca30'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.866425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5c1c0c2dfb4a5d8443e71541eaa9ef', 'request_id': 'req-666e3f19-147e-4cbd-ad46-9cb4def3ca30'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.885326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] The token cache is being invalidate because project fe5c1c0c2dfb4a5d8443e71541eaa9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:22.886086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.887433 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:22.889812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1353/2699] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:22 2022] DELETE /identity/v3/projects/fe5c1c0c2dfb4a5d8443e71541eaa9ef => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:22.904959 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:22.905792 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c05e5e-18e7-4007-b8b8-5edb2c3da1fd service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:22.967410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:22.968329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:22.968637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:22.968914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] PATH_INFO: `/v3/users/1f4bb596b94b4da09f0d4387ea152d1f` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:22.970102 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4bb596b94b4da09f0d4387ea152d1f)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:22.972014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:23.017222 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:23.019330 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:23.032633 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3f19-147e-4cbd-ad46-9cb4def3ca30 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:23.037795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:23.038726 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.039072 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.039263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] PATH_INFO: `/v3/projects/020543613d394717af14c5143698fa5f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.040946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] RBAC: Authorizing `identity:delete_project(project_id=020543613d394717af14c5143698fa5f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:23.042750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:23.185303 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4bb596b94b4da09f0d4387ea152d1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.186366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4bb596b94b4da09f0d4387ea152d1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.187544 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020543613d394717af14c5143698fa5f', 'request_id': 'req-5448a989-5e26-4b89-89e2-19b85164413a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.290644 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4bb596b94b4da09f0d4387ea152d1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.298647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4bb596b94b4da09f0d4387ea152d1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.313200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-63c0d8b1-a055-429a-9522-4642206b37d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4bb596b94b4da09f0d4387ea152d1f'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.322261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1347/2700] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:22 2022] DELETE /identity/v3/users/1f4bb596b94b4da09f0d4387ea152d1f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:23.364977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020543613d394717af14c5143698fa5f', 'request_id': 'req-5448a989-5e26-4b89-89e2-19b85164413a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.375003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020543613d394717af14c5143698fa5f', 'request_id': 'req-5448a989-5e26-4b89-89e2-19b85164413a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.396888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] The token cache is being invalidate because project 020543613d394717af14c5143698fa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:23.399049 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.401023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5448a989-5e26-4b89-89e2-19b85164413a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:23.403207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1354/2701] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:23 2022] DELETE /identity/v3/projects/020543613d394717af14c5143698fa5f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:23.408164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.409126 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.409710 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.435795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:23.437461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:23.516437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1348/2702] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:33:23.517473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.517858 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.518236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.556861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:23.558655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:23.577635 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1355/2703] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:33:23.583593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:23.594585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc878f9-4d3e-433a-a0ed-056d5c2944c3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:23.615605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:23.617215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.617520 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.617936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.619149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:33:23.619552 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:23.626005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:23.643998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1349/2704] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:33:23.648622 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:23.662426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f948-dd2c-4d38-827a-f408ea2fb105 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:23.668929 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:23.669813 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.671697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.671697 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.672677 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:23.674882 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:23.801879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1356/2705] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:23 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:23.804550 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:23.834362 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:23.840086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:23.845791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1837d-34ee-49f6-90d5-408d56e8cf68 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:23.953997 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:23.955139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:23.955593 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:23.956077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:23.958236 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:23.960558 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.001783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e20bf-d586-4234-99e4-67dc35e0a4b9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.007417 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.008739 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.009188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.009765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] PATH_INFO: `/v3/projects/6788a696135b4c8f8cc6c1a6b437045e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.011159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6788a696135b4c8f8cc6c1a6b437045e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.013696 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.055862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1350/2706] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:23 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:24.059700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.071370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643be0-87bf-4e8e-b651-e68594acce69 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.076668 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.077568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.078024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.079247 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.080743 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.083675 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.095514 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1351/2707] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:24.100197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.108825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6788a696135b4c8f8cc6c1a6b437045e', 'request_id': 'req-613e89d4-f645-4419-9e35-9592768489e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:24.112471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2b49-d1e0-4a0d-a672-f612c3823442 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.158634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6788a696135b4c8f8cc6c1a6b437045e', 'request_id': 'req-613e89d4-f645-4419-9e35-9592768489e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:24.167935 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6788a696135b4c8f8cc6c1a6b437045e', 'request_id': 'req-613e89d4-f645-4419-9e35-9592768489e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:24.182651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.187486 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.187977 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.188461 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.189379 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.191425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.199461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] The token cache is being invalidate because project 6788a696135b4c8f8cc6c1a6b437045e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:24.200028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:24.201627 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-613e89d4-f645-4419-9e35-9592768489e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:24.206340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1357/2708] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:23 2022] DELETE /identity/v3/projects/6788a696135b4c8f8cc6c1a6b437045e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:24.216310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1352/2709] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:24.216503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b406-34e7-4e51-97f9-7c8c21c45c07 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.216503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b406-34e7-4e51-97f9-7c8c21c45c07 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.216503 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b406-34e7-4e51-97f9-7c8c21c45c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.216786 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.218569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:24.236949 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081317c-14e5-45e2-bd84-2cdee21660c1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.240580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dbf9b406-34e7-4e51-97f9-7c8c21c45c07 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:24.242851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dbf9b406-34e7-4e51-97f9-7c8c21c45c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:24.244287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.245504 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.246306 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.246753 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] PATH_INFO: `/v3/projects/603496b7745d45ada985126f8c2d1388/users/0b9430142a734e84bad12acd580bb72f/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.254812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1358/2710] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:24.261651 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.261762 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.261990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.270472 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603496b7745d45ada985126f8c2d1388, user_id=0b9430142a734e84bad12acd580bb72f, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.273536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fb93c-96a6-4785-aedf-58343041f2c3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.284389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:24.286308 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:24.295857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1359/2711] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:24.299210 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.310259 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1857213-49cb-4b2c-ac94-ada3cfc756cd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.315700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.316438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.316734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.317012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.318194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:33:24.318675 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.321104 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.346940 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1360/2712] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:33:24.359193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1353/2713] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:24 2022] PUT /identity/v3/projects/603496b7745d45ada985126f8c2d1388/users/0b9430142a734e84bad12acd580bb72f/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:24.359352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.368924 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.369212 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.369493 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.384888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00495-eb78-4843-a6ed-ad50daf57e0d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.419609 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] MFA Rules not processed for user `0b9430142a734e84bad12acd580bb72f`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:24.420937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:24.512913 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.513596 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.513880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.514156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.514849 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.517009 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.530835 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1354/2714] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:24.547941 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.549443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:24.610015 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1361/2715] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:24 2022] POST /identity/v3/projects => generated 355 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:24.614584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.637329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a08fdc-ad7e-4663-987f-48a2dd4fee3c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.699157 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2374c-3680-4020-b433-85423c6a1c9f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.704103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.704848 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.705127 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.705403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.706084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.708671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.720643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.721560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.722099 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.723229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.797288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.799110 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.814469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1362/2716] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:24 2022] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:24.822371 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.822531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1355/2717] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:33:24.828579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38afea-f839-462e-94ac-53825bba2c6c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.843415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.845345 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.846024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.847062 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.848437 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.853297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.873307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1363/2718] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:24.877367 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.889525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413eaab-c26e-439d-9e0d-7780b35a1748 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.894263 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.895664 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.896026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.896378 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.897203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.899295 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acc6d-2933-4483-af56-a2f21fd0f0fc admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:24.914001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1356/2719] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:24.918386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:24.931720 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193f9b-f701-469a-b59f-771f4777d613 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:24.936979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:24.938464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:24.938933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:24.939502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] PATH_INFO: `/v3/projects/57ec22a37e284273aa048651f02230fd/users/49bc6ee7ae4c49ffb6ee7c87fa581ed9/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:24.969016 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ec22a37e284273aa048651f02230fd, user_id=49bc6ee7ae4c49ffb6ee7c87fa581ed9, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:24.983765 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:25.086809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1364/2720] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:24 2022] PUT /identity/v3/projects/57ec22a37e284273aa048651f02230fd/users/49bc6ee7ae4c49ffb6ee7c87fa581ed9/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:25.097855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:25.098446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:25.098446 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:25.146523 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] MFA Rules not processed for user `49bc6ee7ae4c49ffb6ee7c87fa581ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:25.147793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:25.233051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1357/2721] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:25.233170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:25.344604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e249145-4f65-4da2-92c7-383eda3da55c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:25.351491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:25.352540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:25.353040 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:25.353543 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:25.354472 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:25.356818 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:25.495722 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1365/2722] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:25 2022] POST /identity/v3/projects => generated 355 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:25.499699 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:25.511325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559641d5-1585-4d9e-8d3c-3fa56ad3a8d8 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:25.583425 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:25.585501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:25.585501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:25.585501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:25.586507 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:25.590341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:25.709667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1358/2723] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:25 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:25.710974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:25.722374 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e0998-0788-4651-879a-16a4ab46c338 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:25.727668 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:25.728334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:25.729161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:25.729436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:25.730160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:25.731962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:25.747470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1366/2724] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:25.751607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:25.767490 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d6160-6105-49f3-91b2-191da61be75d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:25.772918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:25.773973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:25.774639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:25.774639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] PATH_INFO: `/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d/users/633f83a7374a4d31bc3a4cc9f3ba25df/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:25.792381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c73e4c5ada54203b8c297ba42e17a9d, user_id=633f83a7374a4d31bc3a4cc9f3ba25df, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:25.795153 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:25.942053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1359/2725] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:25 2022] PUT /identity/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d/users/633f83a7374a4d31bc3a4cc9f3ba25df/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:25.948391 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:25.960200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c1ff-0ae7-477e-8e47-b87a460d6679 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:26.023734 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:26.024556 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:26.025497 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:26.025788 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:26.026580 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:26.028766 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe1375-239e-42e5-8b77-218b1a140fd6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:26.040743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1367/2726] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:26.045090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:26.058053 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fd60-8c28-4cc0-9653-07a0c9e13ee1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:26.063522 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:26.064560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:26.064838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:26.065108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] PATH_INFO: `/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d/users/633f83a7374a4d31bc3a4cc9f3ba25df/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:26.069468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c73e4c5ada54203b8c297ba42e17a9d, user_id=633f83a7374a4d31bc3a4cc9f3ba25df, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:26.072286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:26.100533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1360/2727] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:26 2022] PUT /identity/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d/users/633f83a7374a4d31bc3a4cc9f3ba25df/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:26.107214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:26.107506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:26.107907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:26.150174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] MFA Rules not processed for user `633f83a7374a4d31bc3a4cc9f3ba25df`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:26.151461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:26.248396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1368/2728] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:26.258497 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:26.341152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e325-2385-4a80-97cd-3ee1579db5d2 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:26.354966 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:26.357678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:26.357678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:26.357678 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:26.369090 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:26.371084 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00d9b-b8a2-4f97-b963-77498329d58a service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:26.390567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1361/2729] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:26.621054 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:26.638508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e61d8-843a-48f7-8562-2fbfa1ce5df4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:26.650215 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:26.651129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:26.651506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:26.651886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:26.724454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:26.726108 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:26.737094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1369/2730] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:27.433531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:27.434062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:27.434062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:27.462207 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] MFA Rules not processed for user `dff60ffc00c94bacb6218cfd4ea56978`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:27.463442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:27.545492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1362/2731] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:27.547299 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:27.548693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:27.649772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2a3a-1357-4eeb-8296-69372f5c8e72 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:27.659783 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:27.661060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:27.661326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:27.661640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:27.662637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:27.664462 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:27.734536 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1370/2732] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:27 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:27.740620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:27.754542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc0776-80f9-47f9-ad4b-caf1e8172770 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:27.845087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:27.848119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:27.848119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:27.848119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:27.848119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:27.849613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:27.947838 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1363/2733] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:27 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:27.951763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:27.964725 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7412-05f3-4ba7-bd2e-9461b053c88f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:27.969786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:27.974290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:27.974290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:27.974290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:27.974290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:27.974290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:27.986045 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1371/2734] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:27.990745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:28.002233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0600e6-c99c-4cb6-b5d0-44b414684d60 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:28.007066 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:28.007946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:28.008264 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:28.008751 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] PATH_INFO: `/v3/projects/5e8d4af3309f4ee394db586a0c58350e/users/717db2027d124cfda66466ac0b6b2bd4/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:28.025154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8d4af3309f4ee394db586a0c58350e, user_id=717db2027d124cfda66466ac0b6b2bd4, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:28.027957 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:28.136027 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1364/2735] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:27 2022] PUT /identity/v3/projects/5e8d4af3309f4ee394db586a0c58350e/users/717db2027d124cfda66466ac0b6b2bd4/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:28.140160 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:28.169506 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a72-e48b-4892-8b1f-381cea6f4be3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:28.252649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:28.253327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:28.253838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:28.254264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:28.255163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:28.257360 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cd00b-5791-4900-af8b-cce872d07002 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:28.278952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1372/2736] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:28.282866 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:28.299704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01cb02-887a-44cb-b7c6-4b8bec14b8e3 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:28.306574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:28.307480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:28.307761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:28.308146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] PATH_INFO: `/v3/projects/5e8d4af3309f4ee394db586a0c58350e/users/717db2027d124cfda66466ac0b6b2bd4/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:28.310289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8d4af3309f4ee394db586a0c58350e, user_id=717db2027d124cfda66466ac0b6b2bd4, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:28.313082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:28.325063 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1365/2737] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:28 2022] PUT /identity/v3/projects/5e8d4af3309f4ee394db586a0c58350e/users/717db2027d124cfda66466ac0b6b2bd4/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:34.518991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458f7b-1d7f-4a6f-bdd7-fb829be1b959 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:34.519571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458f7b-1d7f-4a6f-bdd7-fb829be1b959 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:34.519571 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458f7b-1d7f-4a6f-bdd7-fb829be1b959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:34.550204 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bb458f7b-1d7f-4a6f-bdd7-fb829be1b959 None None] MFA Rules not processed for user `717db2027d124cfda66466ac0b6b2bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:34.552003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bb458f7b-1d7f-4a6f-bdd7-fb829be1b959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:34.640263 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1373/2738] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:34.652903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:34.654996 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:34.778773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567161e5-349d-4808-97c4-2927bcb8ed9c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:34.786803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:34.787467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:34.787749 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:34.788022 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:34.865588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:34.867393 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:34.877505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1366/2739] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:39.842970 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:39.843475 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:39.843588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:39.861602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:39.863423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:39.917884 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1374/2740] 10.222.0.21 () {58 vars in 1009 bytes} [Tue May 3 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:40.049166 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:40.050865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:40.122780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d1425-1149-4126-911d-89acf712a26b service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:40.129104 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:40.129810 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:40.130086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:40.130358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:40.140592 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:40.143046 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c502a5-7db5-434c-9853-7f5d04c33c57 service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:40.151973 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1367/2741] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 12:33:49.300400 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:49.380004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc338f-eeb7-424b-8695-4352aeec07aa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:49.385262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:49.386623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:49.387010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:49.387290 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] PATH_INFO: `/v3/users/49bc6ee7ae4c49ffb6ee7c87fa581ed9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:49.388666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bc6ee7ae4c49ffb6ee7c87fa581ed9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:49.391004 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:49.583035 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bc6ee7ae4c49ffb6ee7c87fa581ed9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:49.583862 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bc6ee7ae4c49ffb6ee7c87fa581ed9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:49.591636 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bc6ee7ae4c49ffb6ee7c87fa581ed9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:49.672768 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bc6ee7ae4c49ffb6ee7c87fa581ed9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:49.687701 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bc6ee7ae4c49ffb6ee7c87fa581ed9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:49.694442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1375/2742] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:49 2022] DELETE /identity/v3/users/49bc6ee7ae4c49ffb6ee7c87fa581ed9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:49.699059 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:49.699538 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:49.699648 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:49.718615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:49.720026 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:49.787563 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1368/2743] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:49.799664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:49.802902 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:49.862144 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2b0e-0e70-4e88-8bc8-12c35b1f8a0d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:49.866671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:49.868029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:49.868392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:49.872425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:49.880963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:49.882412 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:49.893341 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1376/2744] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:50.502392 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:50.503948 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:50.515779 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150a53-cde4-43da-b58c-ef087f5eb72a None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:50.521690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:50.522967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:50.523258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:50.523606 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] PATH_INFO: `/v3/projects/57ec22a37e284273aa048651f02230fd` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:50.524843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ec22a37e284273aa048651f02230fd)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:50.526744 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:50.648863 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ec22a37e284273aa048651f02230fd', 'request_id': 'req-db88f953-27b8-4224-908b-d2f5bceb8ec4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:50.655578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ec22a37e284273aa048651f02230fd', 'request_id': 'req-db88f953-27b8-4224-908b-d2f5bceb8ec4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:50.662336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ec22a37e284273aa048651f02230fd', 'request_id': 'req-db88f953-27b8-4224-908b-d2f5bceb8ec4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:50.764654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] The token cache is being invalidate because project 57ec22a37e284273aa048651f02230fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:50.766013 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:50.767073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:50.772476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1369/2745] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:50 2022] DELETE /identity/v3/projects/57ec22a37e284273aa048651f02230fd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:50.773473 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:50.783676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d287cc-6d76-43c9-84ca-abdf323b9f0a service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:50.845609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:50.846504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:50.846790 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:50.847093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] PATH_INFO: `/v3/users/633f83a7374a4d31bc3a4cc9f3ba25df` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:50.849490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633f83a7374a4d31bc3a4cc9f3ba25df)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:50.851519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:51.048419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633f83a7374a4d31bc3a4cc9f3ba25df'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.048419 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633f83a7374a4d31bc3a4cc9f3ba25df'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.055196 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633f83a7374a4d31bc3a4cc9f3ba25df'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.112684 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633f83a7374a4d31bc3a4cc9f3ba25df'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.126637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b789cc-9c62-4136-82c8-ce9facf99fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633f83a7374a4d31bc3a4cc9f3ba25df'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.133537 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1377/2746] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:50 2022] DELETE /identity/v3/users/633f83a7374a4d31bc3a4cc9f3ba25df => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:51.578414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:51.580124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:51.595869 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f953-27b8-4224-908b-d2f5bceb8ec4 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:51.691187 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:51.692494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:51.692691 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:51.692897 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] PATH_INFO: `/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:51.694209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c73e4c5ada54203b8c297ba42e17a9d)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:51.696793 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:51.914628 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c73e4c5ada54203b8c297ba42e17a9d', 'request_id': 'req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.922843 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c73e4c5ada54203b8c297ba42e17a9d', 'request_id': 'req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:51.934131 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c73e4c5ada54203b8c297ba42e17a9d', 'request_id': 'req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:52.020639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] The token cache is being invalidate because project 0c73e4c5ada54203b8c297ba42e17a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:52.020961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:52.021571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c0b69e10-732e-4e13-b4d4-d3b8370a40a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:52.023492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1370/2747] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:51 2022] DELETE /identity/v3/projects/0c73e4c5ada54203b8c297ba42e17a9d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:52.028188 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.029508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.029508 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.047489 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:52.048743 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:52.130128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.130526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.130911 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.132495 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1378/2748] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:52.165278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:52.167287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:52.181342 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1371/2749] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:52.186890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.197304 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714faf4-7bb8-4466-93b7-94cba4bcc9bf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.202637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.203607 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.204487 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.204793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.205531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:33:52.205834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.207985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.221707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1379/2750] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:33:52.226441 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.238585 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b73e3-d3b9-42e0-a756-347a105af1cd None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.244643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.245611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.247424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.247424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.247681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.253101 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.348238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1372/2751] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:52.350470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.362392 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed49b3-f1ea-49f4-9a55-7d1f1f0b4dd2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.428469 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.429352 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.430206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.430693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.431971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.435159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.518977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1380/2752] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:52.527011 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.541024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8d4f4-8f39-4125-acea-a1f92448de2c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.545844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.546511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.546783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.547061 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.548079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.549707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.563373 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1373/2753] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:52.568033 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.578871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca860-4d12-48b8-8868-f83f056ede05 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.586289 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.587202 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.587572 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.588170 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.589083 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.594376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b12176-e53c-4449-9756-33ff179e46b4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.608499 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1381/2754] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:52.612673 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.625820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857aa9-2f76-4c2b-8b5e-827c1ac74a54 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.633526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.634880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.635568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.635905 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] PATH_INFO: `/v3/projects/59be7567bd6e4846b9695db55d63ec37/users/24343a9c4dde48f2a5bf991438acdc41/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.658058 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59be7567bd6e4846b9695db55d63ec37, user_id=24343a9c4dde48f2a5bf991438acdc41, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.662268 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:52.755501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1374/2755] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:52 2022] PUT /identity/v3/projects/59be7567bd6e4846b9695db55d63ec37/users/24343a9c4dde48f2a5bf991438acdc41/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:52.766177 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.766837 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.767307 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.797652 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] MFA Rules not processed for user `24343a9c4dde48f2a5bf991438acdc41`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:52.798850 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:52.877510 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1382/2756] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:52.879582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:52.951961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b399-576b-4fb4-ae42-bac7d98cf779 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:52.957930 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:52.958813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:52.959093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:52.959369 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:52.960091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:52.962165 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.049588 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1375/2757] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:52 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:53.054283 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.067612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b757-1427-406b-85e3-6564bca0dd5d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.127820 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.128880 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.129267 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.129742 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.130606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.132448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.210302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1383/2758] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:53 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:53.215466 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.235419 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0135f-2be4-4700-98db-d9bff185d394 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.243414 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.244535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.244918 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.245400 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.247813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.251144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.264594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1376/2759] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:53.269155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.279930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13481acb-6084-4b6d-a410-37a770fdc94e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.285839 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.286869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.287214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.287554 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] PATH_INFO: `/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88/users/a8655a0b8d924048b4ddaca7052213f6/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.312642 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d34a0fbca42432ca98ad6a40ad3df88, user_id=a8655a0b8d924048b4ddaca7052213f6, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.315634 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.381664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1384/2760] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:53 2022] PUT /identity/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88/users/a8655a0b8d924048b4ddaca7052213f6/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:53.385680 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.395783 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11a19-4164-4c02-ac52-f5d6251521e1 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.458294 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.458972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.459253 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.459525 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.460261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.462137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0623b4-133b-4655-993b-7598b8eb6ece admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.476795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1377/2761] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:53.478490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.491637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25616527-39ea-418b-a6ea-0548316d9f05 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.497445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.498340 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.498967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.498967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] PATH_INFO: `/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88/users/a8655a0b8d924048b4ddaca7052213f6/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.501306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d34a0fbca42432ca98ad6a40ad3df88, user_id=a8655a0b8d924048b4ddaca7052213f6, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.504161 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.515793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1385/2762] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:53 2022] PUT /identity/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88/users/a8655a0b8d924048b4ddaca7052213f6/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:53.528209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.528547 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.528844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.559222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] MFA Rules not processed for user `a8655a0b8d924048b4ddaca7052213f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:53.560508 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:53.631216 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1378/2763] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:53.641920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.650832 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:53.716624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b35a-63d0-4e3d-b84f-ee5c86dfd275 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.720998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.722128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.723327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.723774 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.734427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.736124 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d309-bc42-4274-8143-9b3194afa041 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:53.746088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1386/2764] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:33:53.896817 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:53.970320 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7241b7-5e2c-4405-a953-d49e0832d676 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:53.975150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:53.976023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:53.976312 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:53.976616 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] PATH_INFO: `/v3/users/24343a9c4dde48f2a5bf991438acdc41` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:53.977799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24343a9c4dde48f2a5bf991438acdc41)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:53.979707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:54.228877 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24343a9c4dde48f2a5bf991438acdc41'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:54.230091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24343a9c4dde48f2a5bf991438acdc41'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:54.295891 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24343a9c4dde48f2a5bf991438acdc41'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:54.318062 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24343a9c4dde48f2a5bf991438acdc41'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:54.335456 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24343a9c4dde48f2a5bf991438acdc41'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:54.339132 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1379/2765] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:53 2022] DELETE /identity/v3/users/24343a9c4dde48f2a5bf991438acdc41 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:54.347539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:54.348613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:54.348613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:54.367987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:54.368795 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:54.478931 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1387/2766] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:54.496488 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:54.497703 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:54.575197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80c63-5021-4268-9c97-ca73048a5d97 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:54.581374 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:54.581790 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:54.582719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:54.582719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:54.596527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:54.598937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:54.611154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1380/2767] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:55.183449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:55.185817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:55.230856 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620919-c8a6-4f24-9677-7d4920a86b81 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:55.234167 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:55.236268 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:55.236860 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:55.238012 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] PATH_INFO: `/v3/projects/59be7567bd6e4846b9695db55d63ec37` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:55.241660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59be7567bd6e4846b9695db55d63ec37)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:55.247984 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:55.378200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59be7567bd6e4846b9695db55d63ec37', 'request_id': 'req-068088cc-e29c-49a2-a89e-8c112948171a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.461093 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59be7567bd6e4846b9695db55d63ec37', 'request_id': 'req-068088cc-e29c-49a2-a89e-8c112948171a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.468149 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59be7567bd6e4846b9695db55d63ec37', 'request_id': 'req-068088cc-e29c-49a2-a89e-8c112948171a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.480609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] The token cache is being invalidate because project 59be7567bd6e4846b9695db55d63ec37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:55.480956 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.481557 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.483137 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1388/2768] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:55 2022] DELETE /identity/v3/projects/59be7567bd6e4846b9695db55d63ec37 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:55.487117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:55.497937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0b204-257c-4b47-a78a-eab974fe63ce service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:55.578380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:55.579293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:55.579612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:55.579880 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] PATH_INFO: `/v3/users/a8655a0b8d924048b4ddaca7052213f6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:55.581077 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8655a0b8d924048b4ddaca7052213f6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:55.583633 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:55.730582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8655a0b8d924048b4ddaca7052213f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.731286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8655a0b8d924048b4ddaca7052213f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.785791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8655a0b8d924048b4ddaca7052213f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.792667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8655a0b8d924048b4ddaca7052213f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.804759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-eba2bbbe-50a8-4d5b-a4a4-0378d02ab957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8655a0b8d924048b4ddaca7052213f6'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:55.810784 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1381/2769] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:33:55 2022] DELETE /identity/v3/users/a8655a0b8d924048b4ddaca7052213f6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:56.234613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:56.238612 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:56.271281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068088cc-e29c-49a2-a89e-8c112948171a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:56.348926 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:56.349523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:56.349809 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:56.350085 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] PATH_INFO: `/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:56.351449 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d34a0fbca42432ca98ad6a40ad3df88)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:56.353705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:56.487321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d34a0fbca42432ca98ad6a40ad3df88', 'request_id': 'req-5b6e7542-155c-4914-bc2c-9c9644224845'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:56.541092 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d34a0fbca42432ca98ad6a40ad3df88', 'request_id': 'req-5b6e7542-155c-4914-bc2c-9c9644224845'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:56.547948 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d34a0fbca42432ca98ad6a40ad3df88', 'request_id': 'req-5b6e7542-155c-4914-bc2c-9c9644224845'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:56.559955 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] The token cache is being invalidate because project 9d34a0fbca42432ca98ad6a40ad3df88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:33:56.560246 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:56.560917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5b6e7542-155c-4914-bc2c-9c9644224845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:33:56.562936 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1389/2770] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:33:56 2022] DELETE /identity/v3/projects/9d34a0fbca42432ca98ad6a40ad3df88 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:56.568454 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:56.568963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:56.569108 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:56.588249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:56.589808 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:56.661780 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1382/2771] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:33:56.671226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:56.671515 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:56.671810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:56.692753 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:56.694010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:56.703348 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1390/2772] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:56.707517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:56.719385 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7679-2bda-415b-8a54-2f72f74e4c65 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:56.725007 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:56.725645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:56.726341 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:56.726620 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:56.727501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:33:56.727837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:56.730128 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:56.746862 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1383/2773] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:33:56.748171 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:56.760628 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82438ee-507f-4d1e-ab86-4685ccb35080 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:56.766492 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:56.767194 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:56.767484 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:56.767751 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:56.768471 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:56.770434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:56.931565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1391/2774] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:56 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:56.935871 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:56.946917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef99e7-ea6c-47d2-aa1b-3f4a4d5e1424 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.016553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.017325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.017674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.018064 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.018791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.021615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.098809 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1384/2775] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:56 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:57.102967 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.116853 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a35e-71f6-4f73-aa96-6ea43de463f5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.122097 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.122805 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.123094 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.123369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.124113 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.125806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.140416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1392/2776] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:57.143073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.153695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438f2b-a7a7-4a56-9856-ae9c4cc52f2c admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.159188 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.161670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.161670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.161670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.161670 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.164437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e082f-b839-4de7-aa3c-6c079af6fe83 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.173870 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1385/2777] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:57.177985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.190772 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e73cc-0f4e-445f-98d0-37e2574c1c43 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.196775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.197672 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.197974 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.198250 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] PATH_INFO: `/v3/projects/bd4aaf82eab246a3a42dcd5d22a417c6/users/fa443536c05e413588f3c87b1b6273b1/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.215721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4aaf82eab246a3a42dcd5d22a417c6, user_id=fa443536c05e413588f3c87b1b6273b1, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.218491 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.297119 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1393/2778] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:57 2022] PUT /identity/v3/projects/bd4aaf82eab246a3a42dcd5d22a417c6/users/fa443536c05e413588f3c87b1b6273b1/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:57.310258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.310529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.315833 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.346516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] MFA Rules not processed for user `fa443536c05e413588f3c87b1b6273b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:57.346516 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:57.410221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1386/2779] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:57.416318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.517904 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f707cd-a87b-422a-9e40-d289402dc0c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.523236 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.524007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.524305 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.524615 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.525338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.527388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.610229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1394/2780] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:57 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:57.614741 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.625317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46817e24-51b0-44f3-94b1-5ab08e639eff None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.689579 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.690162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.690439 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.690709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.691459 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.693388 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.781533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1387/2781] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:57 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:33:57.785995 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.797700 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1916-5d96-490d-8296-727819fd4193 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.804894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.805623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.805934 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.806264 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.807078 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.809023 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.821273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1395/2782] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:57.825451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.837333 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac865-1e56-4361-bab5-adcf4404c62a admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.842510 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.843406 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.843903 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.844240 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.845112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.846851 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf1d6a-3a99-44a5-a605-bc9f0b55e38a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:57.861233 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1388/2783] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:57.866370 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:57.876519 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024933-2a48-4e19-b203-9bab698851f6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:57.881667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:57.883061 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:57.883546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:57.883816 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] PATH_INFO: `/v3/projects/18abe5b68ba540afbf43091981062656/users/859921ac157d4e87889f882ca1280796/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:57.901851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=18abe5b68ba540afbf43091981062656, user_id=859921ac157d4e87889f882ca1280796, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:57.904867 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.005024 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1396/2784] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:57 2022] PUT /identity/v3/projects/18abe5b68ba540afbf43091981062656/users/859921ac157d4e87889f882ca1280796/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:58.018651 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.019041 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.019882 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.053539 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] MFA Rules not processed for user `859921ac157d4e87889f882ca1280796`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:58.054813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:58.122613 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1389/2785] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:58.195891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.272116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca55a0e-a963-4121-91ac-df513318d3ba admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.277316 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.278007 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.278420 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.278706 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.279410 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.281466 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.375396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1397/2786] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:33:58 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:58.380017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.395067 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3bbc-48f2-4264-965b-1fa173a7781b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.461350 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.462183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.462573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.462961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.463702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.465819 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.570674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1390/2787] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:33:58 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:33:58.576692 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.587729 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f8e1-9827-4d64-bdbd-6be7b3fbcc25 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.594896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.596207 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.600056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.600056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.600056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.600885 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.621502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1398/2788] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:33:58.622919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.638085 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac071-74fd-4b67-9fb4-892b702c8603 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.643246 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.644182 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.644468 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.644886 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] PATH_INFO: `/v3/projects/be2085855a244b1393493af92238b1fc/users/f1db09fbb3f8480489e1c471306589ed/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.664528 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2085855a244b1393493af92238b1fc, user_id=f1db09fbb3f8480489e1c471306589ed, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.667702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.741928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1391/2789] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:58 2022] PUT /identity/v3/projects/be2085855a244b1393493af92238b1fc/users/f1db09fbb3f8480489e1c471306589ed/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:33:58.746538 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.757453 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70da1-b843-4dda-a076-dbb3ce548a47 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.832658 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.833600 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.833946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.834303 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.835380 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.838001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5d6cd-41e7-4f35-bd46-9c2c834f4a38 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.854338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1399/2790] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 12:33:58.858418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:58.868876 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6f3d1-a85b-4b01-bbd4-a1b2f8e0f94b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:58.874018 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:58.874899 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.875170 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.875451 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] PATH_INFO: `/v3/projects/be2085855a244b1393493af92238b1fc/users/f1db09fbb3f8480489e1c471306589ed/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.877450 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2085855a244b1393493af92238b1fc, user_id=f1db09fbb3f8480489e1c471306589ed, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:58.880111 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:58.890987 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1392/2791] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:33:58 2022] PUT /identity/v3/projects/be2085855a244b1393493af92238b1fc/users/f1db09fbb3f8480489e1c471306589ed/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:33:58.905270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:58.905650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:58.905919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:58.933683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] MFA Rules not processed for user `f1db09fbb3f8480489e1c471306589ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:33:58.934900 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:59.007989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1400/2792] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:33:59.020332 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:59.022527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:59.093492 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8a13-7b90-4a33-8843-8c56d2149149 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:59.097023 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:59.098255 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:59.098531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:59.098798 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:59.110667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:59.113012 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f5f68-0d93-4866-96a1-a1d545610751 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:59.127154 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1393/2793] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:33:59.233711 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:33:59.236041 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:33:59.259896 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e245f0f-b4e4-4b1c-9d70-e54357c206b8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:33:59.267158 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:33:59.267996 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:33:59.268278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:33:59.269020 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:33:59.349894 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:33:59.351402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:33:59.363516 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1401/2794] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:33:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:00.783239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0a09-5fd6-4612-9b2f-93874c260672 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:00.783752 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0a09-5fd6-4612-9b2f-93874c260672 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:00.783855 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0a09-5fd6-4612-9b2f-93874c260672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:00.801146 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-f2cb0a09-5fd6-4612-9b2f-93874c260672 None None] MFA Rules not processed for user `dff60ffc00c94bacb6218cfd4ea56978`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:00.802308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f2cb0a09-5fd6-4612-9b2f-93874c260672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:00.857565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1394/2795] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:03.833122 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:03.934493 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba32d3-aaa1-47b6-a9eb-040c0c78b530 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:03.939621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:03.941448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:03.941914 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:03.942183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] PATH_INFO: `/v3/users/fa443536c05e413588f3c87b1b6273b1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:03.943525 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa443536c05e413588f3c87b1b6273b1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:03.945476 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:04.089421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa443536c05e413588f3c87b1b6273b1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:04.090209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa443536c05e413588f3c87b1b6273b1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:04.098593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa443536c05e413588f3c87b1b6273b1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:04.186731 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa443536c05e413588f3c87b1b6273b1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:04.204500 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa443536c05e413588f3c87b1b6273b1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:04.213342 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1402/2796] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:03 2022] DELETE /identity/v3/users/fa443536c05e413588f3c87b1b6273b1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:04.218599 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:04.219138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:04.219231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:04.243476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:04.244727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:04.313683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1395/2797] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:04.324986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:04.326667 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:04.387782 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e27b8-e26d-4af2-83dd-a52189d4e4ab admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:04.391448 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:04.392095 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:04.392386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:04.392680 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:04.402350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:04.403801 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:04.414438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1403/2798] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:05.045745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:05.048042 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:05.071640 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690013dd-d8c0-4028-833a-275f0b81616b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:05.081148 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:05.083567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:05.084491 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:05.093567 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] PATH_INFO: `/v3/projects/bd4aaf82eab246a3a42dcd5d22a417c6` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:05.095421 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4aaf82eab246a3a42dcd5d22a417c6)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:05.114325 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:05.275117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4aaf82eab246a3a42dcd5d22a417c6', 'request_id': 'req-c650e542-fab4-4fea-a39b-1b1729937295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.287286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4aaf82eab246a3a42dcd5d22a417c6', 'request_id': 'req-c650e542-fab4-4fea-a39b-1b1729937295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.293494 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4aaf82eab246a3a42dcd5d22a417c6', 'request_id': 'req-c650e542-fab4-4fea-a39b-1b1729937295'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.442261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] The token cache is being invalidate because project bd4aaf82eab246a3a42dcd5d22a417c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:05.442565 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.443229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.444923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1396/2799] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:05 2022] DELETE /identity/v3/projects/bd4aaf82eab246a3a42dcd5d22a417c6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:05.449193 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:05.464332 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37fbfd-55d3-4c91-9eb8-7c52c86c9378 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:05.521478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:05.522461 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:05.522721 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:05.522989 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] PATH_INFO: `/v3/users/859921ac157d4e87889f882ca1280796` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:05.524178 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] RBAC: Authorizing `identity:delete_user(user_id=859921ac157d4e87889f882ca1280796)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:05.526130 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:05.773442 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859921ac157d4e87889f882ca1280796'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.774199 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859921ac157d4e87889f882ca1280796'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.786174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859921ac157d4e87889f882ca1280796'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.900942 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859921ac157d4e87889f882ca1280796'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.917339 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859921ac157d4e87889f882ca1280796'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:05.927649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1404/2800] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:05 2022] DELETE /identity/v3/users/859921ac157d4e87889f882ca1280796 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:06.501677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:06.503496 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:06.524729 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650e542-fab4-4fea-a39b-1b1729937295 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:06.645482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:06.646643 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:06.647047 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:06.647413 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] PATH_INFO: `/v3/projects/18abe5b68ba540afbf43091981062656` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:06.648847 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18abe5b68ba540afbf43091981062656)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:06.650893 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:06.772654 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18abe5b68ba540afbf43091981062656', 'request_id': 'req-755fffe7-06e3-4543-b870-f9534012e77a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:06.781410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18abe5b68ba540afbf43091981062656', 'request_id': 'req-755fffe7-06e3-4543-b870-f9534012e77a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:06.801179 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18abe5b68ba540afbf43091981062656', 'request_id': 'req-755fffe7-06e3-4543-b870-f9534012e77a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:06.894967 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] The token cache is being invalidate because project 18abe5b68ba540afbf43091981062656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:06.895617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:06.898946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-755fffe7-06e3-4543-b870-f9534012e77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:06.898946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1397/2801] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:06 2022] DELETE /identity/v3/projects/18abe5b68ba540afbf43091981062656 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:06.902641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:06.904833 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:06.920975 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c82f59-46e7-4158-afcf-2cda3684365a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:06.994548 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:06.995526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:06.995870 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:06.996206 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] PATH_INFO: `/v3/users/f1db09fbb3f8480489e1c471306589ed` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:06.998187 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1db09fbb3f8480489e1c471306589ed)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:07.000163 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:07.152603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:07.152894 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:07.153194 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:07.172928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] MFA Rules not processed for user `5be2f874cbd1473fb0fe6fd0acca1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:07.173470 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1db09fbb3f8480489e1c471306589ed'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:07.175767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1db09fbb3f8480489e1c471306589ed'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:07.178135 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:07.183389 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1db09fbb3f8480489e1c471306589ed'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:07.235573 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1398/2802] 10.222.0.21 () {58 vars in 967 bytes} [Tue May 3 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:07.243218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1db09fbb3f8480489e1c471306589ed'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:07.250707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:07.252535 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:07.257294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1db09fbb3f8480489e1c471306589ed'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:07.264184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1405/2803] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:06 2022] DELETE /identity/v3/users/f1db09fbb3f8480489e1c471306589ed => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:07.334355 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661a323-03c1-4dd3-91e1-1d5d013ab147 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:07.395859 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb8f96204ad44d3888970d5335afad3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:07.396600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:07.396884 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:07.397160 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:07.457928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:07.459536 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6bc14-0c3e-402f-9d5f-27f2ced052fd service swift] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:07.467533 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1399/2804] 10.222.0.21 () {60 vars in 1384 bytes} [Tue May 3 12:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 12:34:07.828213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:07.831237 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:07.905017 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea24f-d1a2-4649-8ea8-51997414207d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:07.910280 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:07.911183 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:07.911465 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:07.911806 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] PATH_INFO: `/v3/projects/be2085855a244b1393493af92238b1fc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:07.913082 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2085855a244b1393493af92238b1fc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:07.915086 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.022125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2085855a244b1393493af92238b1fc', 'request_id': 'req-fd07315a-3915-47fd-84b2-245a83a36a6d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:08.083733 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2085855a244b1393493af92238b1fc', 'request_id': 'req-fd07315a-3915-47fd-84b2-245a83a36a6d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:08.094190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2085855a244b1393493af92238b1fc', 'request_id': 'req-fd07315a-3915-47fd-84b2-245a83a36a6d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:08.108565 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] The token cache is being invalidate because project be2085855a244b1393493af92238b1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:08.108857 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:08.109504 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd07315a-3915-47fd-84b2-245a83a36a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:08.111166 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1406/2805] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:07 2022] DELETE /identity/v3/projects/be2085855a244b1393493af92238b1fc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:08.117130 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.125841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.125841 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.138647 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:08.140278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:08.219922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1400/2806] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:08.228274 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.228666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.229029 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.249712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:08.251010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:08.260038 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1407/2807] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:08.263937 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.274394 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de21eb4-dbfa-4c14-a638-33efcf9efa2d None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.279118 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.279800 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.280057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.280327 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.281087 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:34:08.281387 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.283081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.298308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1401/2808] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:34:08.301671 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.311156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796625-1b34-4f60-a1c7-9b62bf96907a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.316602 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.317327 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.317611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.317886 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.318567 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.320524 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.399890 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1408/2809] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:34:08.404482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.414537 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee8a09-0d4e-44e3-aab5-a0e3da3ffa38 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.481590 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.482305 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.482582 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.482885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.483571 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.485529 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.575190 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1402/2810] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:08.579566 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.590302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e84bb-4c47-45a4-868a-88b819c0bb35 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.594927 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.595582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.595861 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.596132 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.596917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.598840 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.611534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1409/2811] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:08.615791 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.627865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f749-3a77-46af-9d30-41471c276486 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.633646 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.637288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.637288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.637288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.637288 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.637794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ad3e7-3552-4d35-8d8b-77f53128a5ae admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.650963 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1403/2812] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:08.651982 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.662397 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56b53-b92d-437e-bfeb-7630bbee6efd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.667120 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.667998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.668278 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.668582 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] PATH_INFO: `/v3/projects/04efa2fe41854660abd1344f7eeb6106/users/f34b6b968c7041dd87fc257db6d3efff/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.686326 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=04efa2fe41854660abd1344f7eeb6106, user_id=f34b6b968c7041dd87fc257db6d3efff, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.689416 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:08.797869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1410/2813] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:08 2022] PUT /identity/v3/projects/04efa2fe41854660abd1344f7eeb6106/users/f34b6b968c7041dd87fc257db6d3efff/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:08.812513 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.812799 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.813098 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.839653 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] MFA Rules not processed for user `f34b6b968c7041dd87fc257db6d3efff`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:08.840795 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:08.903381 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1404/2814] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:08.911638 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:08.980454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683a65-5736-41ea-88d4-af401084bcff admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:08.986422 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:08.987103 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:08.987386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:08.988235 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:08.988991 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:08.990918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.119529 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1411/2815] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:34:08 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:09.123745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.134476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f73ca7-538d-4316-a20d-c8042ca54d49 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.189603 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.190371 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.190667 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.190946 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.191637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.193605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.266458 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1405/2816] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:34:09 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:09.270891 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.280976 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389180-9819-44e4-a885-2f148edfab9a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.286366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.287013 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.287291 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.287559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.288356 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.289952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.300333 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1412/2817] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:09.304380 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.323972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9a0d-b473-4203-8775-567987e4a784 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.328704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.329605 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.329933 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.330134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] PATH_INFO: `/v3/projects/055a671e43634a31ba2c550e2226d53a/users/6d54525009a446ef8bdb9db188d9ea40/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.346403 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a671e43634a31ba2c550e2226d53a, user_id=6d54525009a446ef8bdb9db188d9ea40, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.349566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.420314 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1406/2818] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:09 2022] PUT /identity/v3/projects/055a671e43634a31ba2c550e2226d53a/users/6d54525009a446ef8bdb9db188d9ea40/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:09.425364 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.434421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f993fa-be1b-4e04-95b0-cdc887622001 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.489286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.489946 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.490225 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.490502 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.491200 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.492812 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6e164-8a21-4630-b312-c0a10b2da0c7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.502494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1413/2819] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:09.506641 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.517114 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad65b-8328-43be-8b0e-42c0e10df29b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.522432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.523300 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.523576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.523844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] PATH_INFO: `/v3/projects/055a671e43634a31ba2c550e2226d53a/users/6d54525009a446ef8bdb9db188d9ea40/roles/6b7c1849f40a4c4e9ed4147d19451458` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.526289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a671e43634a31ba2c550e2226d53a, user_id=6d54525009a446ef8bdb9db188d9ea40, role_id=6b7c1849f40a4c4e9ed4147d19451458)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.528951 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.539410 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1407/2820] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:09 2022] PUT /identity/v3/projects/055a671e43634a31ba2c550e2226d53a/users/6d54525009a446ef8bdb9db188d9ea40/roles/6b7c1849f40a4c4e9ed4147d19451458 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:09.557735 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.558057 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.558367 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.584871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] MFA Rules not processed for user `6d54525009a446ef8bdb9db188d9ea40`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:09.586065 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:09.650978 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1414/2821] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:09.662397 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:09.664149 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:09.721215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592f3-c6be-4c2b-a263-eec9e26e85cb admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:09.725076 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:09.725759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:09.726040 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:09.726315 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:09.735676 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:09.739083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:09.746614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1408/2822] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:10.331295 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:10.333724 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:10.397138 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83b70-b78a-4fad-ba9b-7731ac11a433 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:10.401631 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:10.402490 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:10.402763 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:10.403037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] PATH_INFO: `/v3/users/0dc9206365dc4e0b990e65fe795290e5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:10.404180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc9206365dc4e0b990e65fe795290e5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:10.406218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:10.558526 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc9206365dc4e0b990e65fe795290e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:10.559424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc9206365dc4e0b990e65fe795290e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:10.566423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc9206365dc4e0b990e65fe795290e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:10.654454 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc9206365dc4e0b990e65fe795290e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:10.667081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc9206365dc4e0b990e65fe795290e5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:10.673184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1415/2823] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:10 2022] DELETE /identity/v3/users/0dc9206365dc4e0b990e65fe795290e5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:10.852017 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:10.862167 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685b880-684a-45b5-958f-24aae9ff8d25 service cinder] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:10.902282 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:10.903767 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:10.923404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:10.924576 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:10.924702 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:10.925655 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] PATH_INFO: `/v3/users/f34b6b968c7041dd87fc257db6d3efff` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:10.927614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34b6b968c7041dd87fc257db6d3efff)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:10.929554 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:10.970777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee3117-ac51-414a-9bc3-62b2c5ba3f6d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:10.976056 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:10.976937 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:10.977255 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:10.977530 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] PATH_INFO: `/v3/projects/352c16e51c3e44d9b54a0c94d6f74d13` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:10.978693 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=352c16e51c3e44d9b54a0c94d6f74d13)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:10.980650 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.090436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352c16e51c3e44d9b54a0c94d6f74d13', 'request_id': 'req-a902ff76-0a12-403d-9626-f4878c9c7b7a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.090672 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34b6b968c7041dd87fc257db6d3efff'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.091210 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34b6b968c7041dd87fc257db6d3efff'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.162609 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352c16e51c3e44d9b54a0c94d6f74d13', 'request_id': 'req-a902ff76-0a12-403d-9626-f4878c9c7b7a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.168137 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352c16e51c3e44d9b54a0c94d6f74d13', 'request_id': 'req-a902ff76-0a12-403d-9626-f4878c9c7b7a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.179079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] The token cache is being invalidate because project 352c16e51c3e44d9b54a0c94d6f74d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:11.179366 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.179988 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a902ff76-0a12-403d-9626-f4878c9c7b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.181555 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1416/2824] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:10 2022] DELETE /identity/v3/projects/352c16e51c3e44d9b54a0c94d6f74d13 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:11.187242 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a62e0-2379-4b27-830b-5686ecc2d4ca None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.187534 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a62e0-2379-4b27-830b-5686ecc2d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.187835 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a62e0-2379-4b27-830b-5686ecc2d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.202692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34b6b968c7041dd87fc257db6d3efff'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.205649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3b4a62e0-2379-4b27-830b-5686ecc2d4ca None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:11.207606 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3b4a62e0-2379-4b27-830b-5686ecc2d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.210578 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34b6b968c7041dd87fc257db6d3efff'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.222437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-aaf93ef7-184c-4678-aca9-95544f555988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34b6b968c7041dd87fc257db6d3efff'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.228353 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1409/2825] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:10 2022] DELETE /identity/v3/users/f34b6b968c7041dd87fc257db6d3efff => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:11.232740 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.233785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.233785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.249471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:11.250645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.264482 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1417/2826] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:11.273128 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.273415 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.273715 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.293769 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:11.294971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.308323 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1410/2827] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:11.320152 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.321745 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.358640 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1418/2828] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:11.362655 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.371155 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607bdf3-7131-4a78-ac8e-b28e7e63f8f1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.375759 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.376424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.376705 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.376979 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.377874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46b16-7f87-4502-9f53-65f1ae161bee None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.378874 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:34:11.379180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.380784 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.382448 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.383079 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.383360 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.383631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.391950 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1419/2829] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:34:11.392440 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.394476 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.396831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.403714 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1411/2830] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:34:11.406001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa78-ec6e-4535-b623-a104ece47d6c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.410686 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.411376 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.411666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.411938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.412641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.414512 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.501213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1420/2831] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:34:11.505945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.515517 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ba18-a2d9-4fb9-a220-ed65384992a3 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.572234 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.572923 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.573254 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.573527 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.574218 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.576150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.664252 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1412/2832] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:11.665545 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.676793 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f268-2d8e-4612-afd7-db42093206fe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.681523 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.682214 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.682498 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.682800 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.683690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.685309 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.696060 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1421/2833] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:11.700222 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.710399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05eb28-c3e3-4a3b-b86c-7950cd119f7d admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.715200 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.715942 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.716221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.716531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.717250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.718917 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.729998 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1413/2834] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:11.734156 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.745334 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea920ed-7b47-45c9-ad2b-c6078f79e312 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.750018 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.750947 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.751226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.751501 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] PATH_INFO: `/v3/projects/0f107fcc5d914337ab0471b3982efa97/users/9b9f3c99cba447fe895e86753999de01/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.767292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f107fcc5d914337ab0471b3982efa97, user_id=9b9f3c99cba447fe895e86753999de01, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.770002 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcda40-a003-43f2-a8e8-f8a2773a9110 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.844865 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:11.847625 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.863366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860f9f-3ceb-4517-93f4-8542c9b174ea admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:11.868297 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:11.869301 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.869464 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.869739 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] PATH_INFO: `/v3/projects/04efa2fe41854660abd1344f7eeb6106` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.871001 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04efa2fe41854660abd1344f7eeb6106)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:11.872919 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:11.889385 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1422/2835] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:11 2022] PUT /identity/v3/projects/0f107fcc5d914337ab0471b3982efa97/users/9b9f3c99cba447fe895e86753999de01/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:11.899209 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:11.899494 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:11.901846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:11.926547 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] MFA Rules not processed for user `9b9f3c99cba447fe895e86753999de01`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:11.927777 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:11.962888 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04efa2fe41854660abd1344f7eeb6106', 'request_id': 'req-f9235f39-c0e7-4885-90ef-d91b846c8186'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.969370 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04efa2fe41854660abd1344f7eeb6106', 'request_id': 'req-f9235f39-c0e7-4885-90ef-d91b846c8186'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.975144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04efa2fe41854660abd1344f7eeb6106', 'request_id': 'req-f9235f39-c0e7-4885-90ef-d91b846c8186'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:11.994588 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1423/2836] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 12:34:12.005619 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:12.006961 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.024986 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] The token cache is being invalidate because project 04efa2fe41854660abd1344f7eeb6106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:12.025271 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.025952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.027660 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1414/2837] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:11 2022] DELETE /identity/v3/projects/04efa2fe41854660abd1344f7eeb6106 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:12.031553 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:12.034005 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.062807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807016e-57a3-4722-adb5-1ce5854f908b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:12.098117 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235f39-c0e7-4885-90ef-d91b846c8186 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:12.102879 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:12.103750 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.104032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.104310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] PATH_INFO: `/v3/users/6d54525009a446ef8bdb9db188d9ea40` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.105544 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d54525009a446ef8bdb9db188d9ea40)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:12.107467 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:12.110997 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:12.111690 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.111969 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.112240 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.114611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.170406 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:12.172273 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:12.182148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1424/2838] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:34:12.207838 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:12.209292 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.222889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a40cf-d103-472b-b504-49f50a74bcc5 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:12.227550 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:12.228434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.228714 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.229001 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] PATH_INFO: `/v3/users/9b9f3c99cba447fe895e86753999de01` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.230184 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9f3c99cba447fe895e86753999de01)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:12.232218 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:12.256232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d54525009a446ef8bdb9db188d9ea40'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.256914 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d54525009a446ef8bdb9db188d9ea40'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.317119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d54525009a446ef8bdb9db188d9ea40'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.324209 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d54525009a446ef8bdb9db188d9ea40'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.336261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-b11d4fd5-3f7f-475d-9101-7238c4d84932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d54525009a446ef8bdb9db188d9ea40'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.342875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1415/2839] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:12 2022] DELETE /identity/v3/users/6d54525009a446ef8bdb9db188d9ea40 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:12.383036 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9f3c99cba447fe895e86753999de01'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.384022 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9f3c99cba447fe895e86753999de01'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.391834 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9f3c99cba447fe895e86753999de01'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.443239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9f3c99cba447fe895e86753999de01'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.454977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9f3c99cba447fe895e86753999de01'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.461597 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1425/2840] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:12 2022] DELETE /identity/v3/users/9b9f3c99cba447fe895e86753999de01 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:34:12.466109 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.466399 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.466677 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.483936 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:12.485173 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.543095 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1416/2841] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:12.557962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:12.557962 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.612116 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c15e1-13ad-471a-a476-aba0b77a6855 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:12.615798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:12.616463 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.616745 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.617044 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.626395 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:12.628688 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:12.638775 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1426/2842] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:12.794759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:12.796197 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:12.808094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567df58-a971-49e9-8b35-5aeb2f824c1c None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:12.814112 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:12.820737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:12.820737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:12.820737 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] PATH_INFO: `/v3/projects/055a671e43634a31ba2c550e2226d53a` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:12.820990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=055a671e43634a31ba2c550e2226d53a)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:12.822754 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:12.939837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055a671e43634a31ba2c550e2226d53a', 'request_id': 'req-4aded328-001b-4992-af4f-595c14c2bbcf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.946708 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055a671e43634a31ba2c550e2226d53a', 'request_id': 'req-4aded328-001b-4992-af4f-595c14c2bbcf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:12.952228 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055a671e43634a31ba2c550e2226d53a', 'request_id': 'req-4aded328-001b-4992-af4f-595c14c2bbcf'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.025856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] The token cache is being invalidate because project 055a671e43634a31ba2c550e2226d53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:13.026142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.026759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-4aded328-001b-4992-af4f-595c14c2bbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.028348 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1417/2843] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:12 2022] DELETE /identity/v3/projects/055a671e43634a31ba2c550e2226d53a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:13.194306 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.195773 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:13.213611 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4c28-70e0-48a0-a57e-96f7408cd873 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.271945 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.272869 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.273152 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.273430 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] PATH_INFO: `/v3/projects/0f107fcc5d914337ab0471b3982efa97` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.274660 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f107fcc5d914337ab0471b3982efa97)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.276647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.397066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f107fcc5d914337ab0471b3982efa97', 'request_id': 'req-260dd649-1fbb-473d-9571-26aba3222513'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.448689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f107fcc5d914337ab0471b3982efa97', 'request_id': 'req-260dd649-1fbb-473d-9571-26aba3222513'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.454311 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f107fcc5d914337ab0471b3982efa97', 'request_id': 'req-260dd649-1fbb-473d-9571-26aba3222513'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.465350 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] The token cache is being invalidate because project 0f107fcc5d914337ab0471b3982efa97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:13.465630 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.466258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-260dd649-1fbb-473d-9571-26aba3222513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:13.467859 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1427/2844] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:13 2022] DELETE /identity/v3/projects/0f107fcc5d914337ab0471b3982efa97 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:13.473150 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.473437 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.473727 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.491634 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:13.492849 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:13.549082 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1418/2845] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:13.557373 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.557661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.557939 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.575564 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:13.578068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:13.584881 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1428/2846] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:13.588994 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.598929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4073-5f27-4606-8d2f-f8a0cc7567f3 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.603317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.603952 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.604229 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.604569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.605278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:34:13.605575 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.607143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.618844 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1419/2847] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 12:34:13.622952 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.631871 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6570b-6e77-4583-a0dc-ab566c3336c4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.636444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.637087 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.640037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.640037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.640037 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.640310 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.724213 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1429/2848] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:34:13 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:13.728177 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.737864 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7753e33-d478-4202-8b53-717666f6bf05 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.791860 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.792542 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.792820 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.793092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] PATH_INFO: `/v3/users` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.793776 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.795722 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.923617 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1420/2849] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:34:13 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:34:13.927925 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.938302 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f716175-a176-4e48-a181-53584739e412 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.943637 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.944388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.944649 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.944919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.945624 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.947186 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.957384 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1430/2850] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:13.961142 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:13.971094 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca4b3-b450-450f-b6f2-96b2f3d635bd admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:13.975759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:13.976442 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:13.976720 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:13.976990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:13.977700 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:13.979266 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6179dcc-25b0-41cd-8d3f-83d721af6065 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:13.989684 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1421/2851] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:13.994478 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:14.005676 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93c07-5adb-40a6-ba86-80ff09b23dea admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:14.010425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:14.011338 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:14.011616 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:14.011888 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] PATH_INFO: `/v3/projects/72a530ccad99478e9a52b7a41c175a7f/users/17cdbf4fe487426992288603962d33be/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:14.026328 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a530ccad99478e9a52b7a41c175a7f, user_id=17cdbf4fe487426992288603962d33be, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:14.028998 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:14.114003 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1431/2852] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:13 2022] PUT /identity/v3/projects/72a530ccad99478e9a52b7a41c175a7f/users/17cdbf4fe487426992288603962d33be/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:14.179875 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:14.180091 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:14.180336 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:14.206124 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] MFA Rules not processed for user `17cdbf4fe487426992288603962d33be`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:14.207317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:14.268239 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1422/2853] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:14.278987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:14.280756 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:14.335625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952948-1bbe-4512-b551-94e82797a9f4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:14.339226 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:14.339863 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:14.340140 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:14.340452 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:14.349426 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:14.350878 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:14.359712 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1432/2854] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 12:34:20.177129 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:20.178511 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:20.234032 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d4e8-d196-4caf-84f7-94443f1029ce None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:20.237521 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:20.238157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:20.238430 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:20.238707 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:20.240498 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:20.301560 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:20.303020 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea784-0024-4057-ba35-0fff5528409e service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:20.312304 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1423/2855] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:20.348802 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:20.350261 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:20.413851 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3b69f-c143-4779-b972-ee4eaff7f2a8 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:20.418755 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:20.419817 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:20.420101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:20.420438 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] PATH_INFO: `/v3/users/0b9430142a734e84bad12acd580bb72f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:20.421623 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9430142a734e84bad12acd580bb72f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:20.423831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:20.642758 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9430142a734e84bad12acd580bb72f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:20.643369 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9430142a734e84bad12acd580bb72f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:20.650965 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9430142a734e84bad12acd580bb72f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:20.740981 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9430142a734e84bad12acd580bb72f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:20.759286 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9430142a734e84bad12acd580bb72f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:20.766513 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1433/2856] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:20 2022] DELETE /identity/v3/users/0b9430142a734e84bad12acd580bb72f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:20.775377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:20.775377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:20.775377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:20.792183 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:20.793424 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:20.858639 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1424/2857] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:20.866260 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:20.867983 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:20.938151 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3c670-4cd8-41de-85c1-f277baccc1e0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:20.941786 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:20.942570 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:20.942908 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:20.943190 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:20.952807 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:20.954239 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf4b0-4460-492c-9441-19d75daa321e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:20.964689 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1434/2858] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:21.342354 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:21.345231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:21.367501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59769c7-29f1-4b77-addf-50681ef482e5 None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:21.373073 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:21.374071 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.379856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.379856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] PATH_INFO: `/v3/projects/603496b7745d45ada985126f8c2d1388` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.379856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=603496b7745d45ada985126f8c2d1388)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:21.379856 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:21.471250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603496b7745d45ada985126f8c2d1388', 'request_id': 'req-2965efe5-ff33-48be-9848-031a1bd7d12a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:21.477656 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603496b7745d45ada985126f8c2d1388', 'request_id': 'req-2965efe5-ff33-48be-9848-031a1bd7d12a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:21.485597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603496b7745d45ada985126f8c2d1388', 'request_id': 'req-2965efe5-ff33-48be-9848-031a1bd7d12a'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:21.534615 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] The token cache is being invalidate because project 603496b7745d45ada985126f8c2d1388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:21.534988 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:21.535705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-2965efe5-ff33-48be-9848-031a1bd7d12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:21.537890 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1425/2859] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:21 2022] DELETE /identity/v3/projects/603496b7745d45ada985126f8c2d1388 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:21.543081 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.548262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.548262 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.562318 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:21.565010 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:21.626905 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1435/2860] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:21.635961 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.636250 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.636569 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.657308 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:21.658531 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:21.667455 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1426/2861] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:21.671918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:21.683485 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430be65-24b6-4256-98cd-47b6beb091a8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:21.689604 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:21.690346 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.690621 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.691079 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.691846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 12:34:21.692223 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:21.694258 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:21.710760 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1436/2862] 10.222.0.21 () {58 vars in 1152 bytes} [Tue May 3 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 12:34:21.712945 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:21.725291 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f74a12-ff9f-4544-8622-70e44b2ce8fa None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:21.730645 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:21.731436 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.731972 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.732307 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.733119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:21.735432 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:21.822596 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1427/2863] 10.222.0.21 () {60 vars in 1152 bytes} [Tue May 3 12:34:21 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 12:34:21.826778 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:21.841468 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663cd1-7753-4aeb-870d-97150e46c8c5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:21.898088 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:21.898957 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:21.899357 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:21.899749 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:21.900539 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:21.902531 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:21.987889 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1437/2864] 10.222.0.21 () {60 vars in 1143 bytes} [Tue May 3 12:34:21 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 12:34:21.988404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:21.999500 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0289-617a-452f-a7ab-4a7ff42da25b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:22.004289 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:22.005057 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:22.005443 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:22.005608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] PATH_INFO: `/v3/roles` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:22.014895 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:22.016584 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:22.028196 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1428/2865] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:22.033396 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:22.042825 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d00e-2b4a-4603-9e3f-8313bffa5f2e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:22.047695 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:22.048353 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:22.048661 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:22.048938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:22.049681 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:22.051275 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1e4b7-f9bc-466d-bf8a-dcab54258991 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:22.061066 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1438/2866] 10.222.0.21 () {58 vars in 1121 bytes} [Tue May 3 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 12:34:22.065329 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:22.075139 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa36fc-9ae3-4b90-be41-2b753b14788f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:22.079705 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:22.080611 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:22.080889 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:22.081162 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] PATH_INFO: `/v3/projects/7564abbd1a4f4e85818ce5092358741e/users/f331191a07d34db6a9f18cf5eca35020/roles/31051132b0f6448abb7a60bb660c8c14` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:22.096093 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7564abbd1a4f4e85818ce5092358741e, user_id=f331191a07d34db6a9f18cf5eca35020, role_id=31051132b0f6448abb7a60bb660c8c14)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:22.098756 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:22.152518 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1429/2867] 10.222.0.21 () {60 vars in 1482 bytes} [Tue May 3 12:34:22 2022] PUT /identity/v3/projects/7564abbd1a4f4e85818ce5092358741e/users/f331191a07d34db6a9f18cf5eca35020/roles/31051132b0f6448abb7a60bb660c8c14 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:22.163229 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:22.163584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:22.163865 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:22.193363 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] MFA Rules not processed for user `f331191a07d34db6a9f18cf5eca35020`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:22.194579 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:22.259403 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1439/2868] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:22.270934 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:22.273427 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:22.356794 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6707397-cb10-404e-b088-ee063017ae7f admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:22.363281 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8055b211f0f48ee89f209dacd33837c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:22.364495 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:22.364797 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:22.365214 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:22.374356 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:22.375785 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9736-5fb0-48f9-8204-e4f9afca0e64 service cinder] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:22.385081 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1430/2869] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:25.595148 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:25.601174 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:25.659932 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd00e-1508-4bb8-9239-683c3c61935b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:25.664575 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:25.665429 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:25.665704 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:25.665972 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] PATH_INFO: `/v3/users/17cdbf4fe487426992288603962d33be` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:25.667126 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cdbf4fe487426992288603962d33be)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:25.669046 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:25.855285 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cdbf4fe487426992288603962d33be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:25.859920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cdbf4fe487426992288603962d33be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:25.862402 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cdbf4fe487426992288603962d33be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:25.916654 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cdbf4fe487426992288603962d33be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:25.929100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cdbf4fe487426992288603962d33be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:25.934917 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1440/2870] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:25 2022] DELETE /identity/v3/users/17cdbf4fe487426992288603962d33be => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:25.939366 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:25.939850 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:25.939958 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:25.957193 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:25.958358 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:26.014595 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1431/2871] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:26.024169 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:26.025593 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:26.080779 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec92c73-7e74-4b92-983e-ded5ddd5129d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:26.084336 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:26.084987 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:26.085270 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:26.085546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:26.094297 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:26.095707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:26.105464 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1441/2872] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:26.490121 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:26.491568 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:26.503482 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be9fc-9afb-4b24-add3-3c3854cff27e None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:26.509038 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:26.510278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:26.510278 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:26.510594 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] PATH_INFO: `/v3/projects/72a530ccad99478e9a52b7a41c175a7f` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:26.511607 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a530ccad99478e9a52b7a41c175a7f)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:26.513631 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:26.619803 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a530ccad99478e9a52b7a41c175a7f', 'request_id': 'req-f1b66249-f60a-4dea-9878-d887c0ce6820'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:26.625881 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a530ccad99478e9a52b7a41c175a7f', 'request_id': 'req-f1b66249-f60a-4dea-9878-d887c0ce6820'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:26.631238 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a530ccad99478e9a52b7a41c175a7f', 'request_id': 'req-f1b66249-f60a-4dea-9878-d887c0ce6820'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:26.711293 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] The token cache is being invalidate because project 72a530ccad99478e9a52b7a41c175a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:26.711612 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:26.712225 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-f1b66249-f60a-4dea-9878-d887c0ce6820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:26.713796 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1432/2873] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:26 2022] DELETE /identity/v3/projects/72a530ccad99478e9a52b7a41c175a7f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:43.073421 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:43.074830 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:43.087032 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b386-4cb0-4533-a996-9df15a2be810 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:43.143903 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:43.144810 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:43.145089 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:43.145359 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] PATH_INFO: `/v3/users/f331191a07d34db6a9f18cf5eca35020` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:43.146520 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f331191a07d34db6a9f18cf5eca35020)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:43.148424 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:43.301434 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f331191a07d34db6a9f18cf5eca35020'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:43.302096 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f331191a07d34db6a9f18cf5eca35020'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:43.309388 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f331191a07d34db6a9f18cf5eca35020'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:43.379458 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f331191a07d34db6a9f18cf5eca35020'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:43.391224 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f331191a07d34db6a9f18cf5eca35020'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:43.396999 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1442/2874] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:34:43 2022] DELETE /identity/v3/users/f331191a07d34db6a9f18cf5eca35020 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:34:43.402097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] REQUEST_METHOD: `POST` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:43.402097 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:43.402681 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:43.420690 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.auth.core [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] MFA Rules not processed for user `999bb4f35c6e4023831d5433d656d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:34:43.421885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:43.482624 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1433/2875] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:34:43.492217 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:43.493647 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:43.550279 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e98bc-983b-4306-aa2d-54de3240ccf4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:43.553918 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:43.554551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:43.554855 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:43.555125 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:43.568201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:43.568201 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:43.575100 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1443/2876] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:34:43.941137 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:34:43.942623 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:34:43.955885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257ad9-d9bc-4e65-bdff-baa01d02a47b None None] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:34:43.960608 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:34:43.961471 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:34:43.961748 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:34:43.962015 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] PATH_INFO: `/v3/projects/7564abbd1a4f4e85818ce5092358741e` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:34:43.963956 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7564abbd1a4f4e85818ce5092358741e)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:34:43.965874 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:34:44.063272 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7564abbd1a4f4e85818ce5092358741e', 'request_id': 'req-acf93e89-9b23-4543-92e3-c0a6762c27b7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:44.069221 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7564abbd1a4f4e85818ce5092358741e', 'request_id': 'req-acf93e89-9b23-4543-92e3-c0a6762c27b7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:44.075089 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7564abbd1a4f4e85818ce5092358741e', 'request_id': 'req-acf93e89-9b23-4543-92e3-c0a6762c27b7'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:44.121092 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] The token cache is being invalidate because project 7564abbd1a4f4e85818ce5092358741e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:34:44.121310 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:44.121915 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:34:44.123480 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1434/2877] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:34:43 2022] DELETE /identity/v3/projects/7564abbd1a4f4e85818ce5092358741e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:35:37.601540 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:35:37.609980 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fcdab-e4a5-45ac-8e32-d6efe164030b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:35:37.656985 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:35:37.657625 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:35:37.657907 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:35:37.658180 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:35:37.659920 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:35:37.668990 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:35:37.670436 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:35:37.678425 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1444/2878] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:35:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:20.132692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:20.134168 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:20.146444 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93e89-9b23-4543-92e3-c0a6762c27b7 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:20.150138 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:20.150773 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:20.151052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:20.151837 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:20.153695 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:20.221389 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:20.222833 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:20.234249 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1435/2879] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:21.406324 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:21.407798 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:21.418559 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd144-4a8e-4443-8939-df763a22eec4 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:21.422238 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:21.423129 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:21.423409 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:21.423683 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:21.425444 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:21.439039 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:21.440480 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda7625-5383-4e75-9574-c60bc2288d6b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:21.451321 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1445/2880] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:22.699155 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:22.700928 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:22.718716 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063550-2760-40d6-b167-b29817906740 service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:22.724669 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:22.725771 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:22.725985 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:22.726203 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:22.727990 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:22.740674 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:22.742279 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:22.755630 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1436/2881] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:24.830963 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:24.831445 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:24.831546 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:24.847879 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] MFA Rules not processed for user `dff60ffc00c94bacb6218cfd4ea56978`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:36:24.849101 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:24.901405 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1446/2882] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:36:25.206261 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:25.215574 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429a3b-5977-4012-bc89-82de38bc5678 service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:25.219286 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:25.219929 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:25.220215 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:25.220526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:25.222317 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:25.232704 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:25.234119 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:25.241981 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1437/2883] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:27.029846 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:27.031294 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:27.103317 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cebb2-47ce-4aa9-8ae3-4a4be32e1d84 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:27.108971 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:27.109664 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:27.109919 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:27.110192 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:27.112074 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:27.124930 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:27.126507 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:27.140641 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1447/2884] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:44.330815 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:44.373939 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a3b9-d226-4af8-a5fd-388a292903fa service neutron] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:44.379343 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:44.379979 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:44.380258 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:44.380566 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:44.382347 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:44.412601 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:44.414232 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:44.426051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1438/2885] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:36:48.878028 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:36:48.919750 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d879b3-333a-411d-b103-a7c6e6f66bfe service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:36:48.925423 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:36:48.926058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:36:48.926335 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:36:48.926613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:36:48.928355 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:36:48.940584 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:36:48.942135 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9903-e8e5-49e7-aa61-b84cbbb6e626 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:36:48.953068 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1448/2886] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:36:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:37:39.933113 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:37:39.934505 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:37:39.968597 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bfaf-cda8-4941-9a62-31036ffa039a service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:37:39.973501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:37:39.974134 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:37:39.974412 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:37:39.974709 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:37:39.976457 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:37:39.987719 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:37:39.989362 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:37:39.999404 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1439/2887] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:37:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:38:20.067393 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:38:20.067993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:38:20.067993 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:38:20.085071 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] MFA Rules not processed for user `dff60ffc00c94bacb6218cfd4ea56978`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 12:38:20.086943 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:38:20.093912 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1449/2888] 10.222.0.21 () {58 vars in 957 bytes} [Tue May 3 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 12:38:34.848157 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:38:34.882418 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ebac-19ec-4e8d-bec9-25e339bb97e1 service placement] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:38:34.888663 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1222910d5aea4308ae5083faf6bc753a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:38:34.889408 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:38:34.889683 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:38:34.889983 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:38:34.891904 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:38:34.903052 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:38:34.904759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:38:34.913964 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1440/2889] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:40:21.461551 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:40:21.480281 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56685c-9b6d-4ba7-934e-9637b2cf94f4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:40:21.483876 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fddb5e13094f454283de3020e1febc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:40:21.484542 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:40:21.484827 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:40:21.485105 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:40:21.486843 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:40:21.567159 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:40:21.568613 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:40:21.587427 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1450/2890] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 12:40:28.522024 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:40:28.523526 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:40:28.536730 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1ae5b-5cf7-484b-9df6-47d60f5ece43 service nova] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:40:28.541292 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:40:28.542086 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:40:28.542365 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:40:28.542637 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] PATH_INFO: `/v3/users/dff60ffc00c94bacb6218cfd4ea56978` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:40:28.543825 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff60ffc00c94bacb6218cfd4ea56978)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:40:28.545759 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:40:28.705144 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff60ffc00c94bacb6218cfd4ea56978'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:28.705813 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff60ffc00c94bacb6218cfd4ea56978'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:28.778692 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff60ffc00c94bacb6218cfd4ea56978'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:28.785787 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff60ffc00c94bacb6218cfd4ea56978'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:28.797922 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff60ffc00c94bacb6218cfd4ea56978'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:28.803761 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1441/2891] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:40:28 2022] DELETE /identity/v3/users/dff60ffc00c94bacb6218cfd4ea56978 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:40:29.037296 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:40:29.047831 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a60fb-a8c7-4a1b-bff0-3f255e3eca28 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:40:29.105527 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:40:29.106381 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:40:29.106666 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:40:29.106938 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] PATH_INFO: `/v3/projects/63e643aec806497bb42c62ea76c402f4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:40:29.108107 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e643aec806497bb42c62ea76c402f4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:40:29.110034 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:40:29.240662 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e643aec806497bb42c62ea76c402f4', 'request_id': 'req-e662f79c-fb13-4e98-bb89-2e2eab6baa84'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.321386 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e643aec806497bb42c62ea76c402f4', 'request_id': 'req-e662f79c-fb13-4e98-bb89-2e2eab6baa84'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.326643 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e643aec806497bb42c62ea76c402f4', 'request_id': 'req-e662f79c-fb13-4e98-bb89-2e2eab6baa84'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.337703 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] The token cache is being invalidate because project 63e643aec806497bb42c62ea76c402f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:40:29.337986 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.342084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.342084 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1451/2892] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:40:29 2022] DELETE /identity/v3/projects/63e643aec806497bb42c62ea76c402f4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 12:40:29.344164 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:40:29.345600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:40:29.359316 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ade67-9efd-4b59-8458-bf288d37ce6b admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:40:29.413068 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:40:29.413954 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:40:29.414231 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:40:29.414501 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] PATH_INFO: `/v3/users/717db2027d124cfda66466ac0b6b2bd4` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:40:29.415665 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717db2027d124cfda66466ac0b6b2bd4)` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:40:29.417600 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:40:29.625377 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717db2027d124cfda66466ac0b6b2bd4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.626037 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717db2027d124cfda66466ac0b6b2bd4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.691143 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717db2027d124cfda66466ac0b6b2bd4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.698416 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717db2027d124cfda66466ac0b6b2bd4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.709832 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.notifications [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717db2027d124cfda66466ac0b6b2bd4'} {{(pid=80132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:29.716287 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1442/2893] 10.222.0.21 () {58 vars in 1223 bytes} [Tue May 3 12:40:29 2022] DELETE /identity/v3/users/717db2027d124cfda66466ac0b6b2bd4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:40:29.951272 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:40:29.952707 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:40:29.965828 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f79c-fb13-4e98-bb89-2e2eab6baa84 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:40:30.021131 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '999bb4f35c6e4023831d5433d656d3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04ced0b5ee84470a3d6e754eca1d8a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:40:30.021977 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:40:30.022254 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:40:30.022521 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] PATH_INFO: `/v3/projects/5e8d4af3309f4ee394db586a0c58350e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:40:30.024154 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8d4af3309f4ee394db586a0c58350e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:40:30.026141 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:40:30.143933 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8d4af3309f4ee394db586a0c58350e', 'request_id': 'req-b292c626-478c-4fa1-9d18-9b7e182c2102'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:30.184110 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8d4af3309f4ee394db586a0c58350e', 'request_id': 'req-b292c626-478c-4fa1-9d18-9b7e182c2102'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:30.189916 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8d4af3309f4ee394db586a0c58350e', 'request_id': 'req-b292c626-478c-4fa1-9d18-9b7e182c2102'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:30.200674 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] The token cache is being invalidate because project 5e8d4af3309f4ee394db586a0c58350e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 12:40:30.200899 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:30.201517 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b292c626-478c-4fa1-9d18-9b7e182c2102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 12:40:30.203058 dv-cinder-824911-5-iscsi devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1452/2894] 10.222.0.21 () {58 vars in 1232 bytes} [Tue May 3 12:40:29 2022] DELETE /identity/v3/projects/5e8d4af3309f4ee394db586a0c58350e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 12:42:45.864687 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Authenticating user token {{(pid=80132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 12:42:45.866083 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:42:45.931885 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd250-bb41-487b-ad2d-9fb1b33a4943 admin admin] Validating token access rules against request {{(pid=80132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 12:42:45.990080 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8536acd053b44e48493e68622d82d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b51b9eb70df40c4af8fde5ab24ad2f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 12:42:45.990731 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] REQUEST_METHOD: `GET` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 12:42:45.991014 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] SCRIPT_NAME: `/identity` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 12:42:45.991284 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 12:42:45.993051 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.fernet_utils [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 12:42:46.004010 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 12:42:46.005614 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba26ba2-42fd-4a2e-9260-7a48d5d573ed service placement] RBAC: Authorization granted {{(pid=80132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 12:42:46.015701 dv-cinder-824911-5-iscsi devstack@keystone.service[80132]: [pid: 80132|app: 0|req: 1443/2895] 10.222.0.21 () {60 vars in 1365 bytes} [Tue May 3 12:42:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)